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This  Note  is  part  of  a  series  of  Notes  that 
derive  a  set  of  equations  suitable  for 
estimating  the  acquisition  costs  of  various 
types  of  aircraft  airframes  in  the  absence 
of  detailed  design  and  manufacturing 
information,  A  single  set  of  equations  was 
selected  as  being  the  most  representative 
and  applicable  to  the  widest  range  of 
estimating  situations.  For  fighters,  the 
the  equation  set  uses  airframe  unit  weight 
as  the  variable.  Kox^y-i 
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ajsification  this  PAOKOtr, 


PREFACE 


This  Note  describes  the  derivation  of  a  set  of  equations  suitable 
for  estimating  the  acquisition  costs  of  fighter  aircraft  airframes  in 
the  absence  of  detailed  design  and  manufacturing  Information.  In  broad 
form,  the  research  represents  an  extension  o^  the  results  nublishod  in 
J.  P.  Large  et  al. ,  Parametr ic  Equations  for  Estimating  Aircraft 
Airframe  Costs,  R-1693-l-PA6iE ,  The  RAND  Corporation,  February  1976,  and 
used  in  the  RAND  aircraft  cost  model,  DAPGA;  H.  E.  Boren,  Jr.,  A 
Computer  Model  for  Estimating  Development  and  Procurement  Costs  of 
Aircraft  (UAPCA-III),  R-1854-PR,  The  RAND  Corporation,  March  1976. 

The  present  effort  was  undertaken  in  the  context  of  a  larger 
overall  study  whose  objectives  included:  (a)  an  analysis  of  the  utility 
of  dividing  the  full  estimating  sample  into  subsamples  representing 
major  differences  in  aircraft  type  (attack,  fighter,  and 
bomber/transport) ;  and  (b)  an  examination  of  the  explanatory  power  of 
variables  describing  program  structure  and  airframe  construction 
techniques.  Additionally,  for  the  fighter  subsample  only,  the  study 
investigated  the  possible  benefits  of  incorporating  an  objective 
technology  measure  into  the  equations.  A  detailed  description  of  the 
overall  study,  including  the  research  approach,  evaluation  criteria,  and 
database  may  be  found  in  R,  W.  Hess  and  H.  P.  Romanoff,  Aircraft 
Airframe  Cast  Estimating  Relationships :  Study  Approach  and  Conclusions , 
R-32.55 “AF ,  The  RAND  Corporation,  December  1987. 

To  address  the  issue  of  sample  homogeneity,  each  of  the  subsamples, 
as  well  as  the  full  sample,  had  to  be  investigated  in  detail  with  the 
ultimate  goal  of  developing  representative  sets  of  cost  estimating 
relationships  (CRRs)  for  each.  The  purpose  of  this  Note  is,  therefore, 
to  document  the  selection  of  a  representative  set  of  CERs  for  the 
fighter  subsample.  Study  results  concerning  the  full  estimating  sample 
as  well  as  the  other  subsamples  are  available  in  a  series  of  companion 
Notes : 


Aircraft  Airframe  Cost  Estimating  Relationships :  All  Mission  Types, 
N-2283/1-AF,  December  1987. 


Aircraft  Airframe  Cost  Estimating  Rr  .  'tionships:  Bombers  and  Transport 

N-2283/3-AF,  December  1987. 

Aircraft  Airframe  Cost  Estimating  Relationships:  Attack  Aircraft, 

N-2283/4-AF,  December  1987. 

This  research  was  undertaken  as  part  of  the  Project  Air  Force  study 
titled  "Cost  Analysis  Methods  for  Air  Force  Systems,"  which  has  been 
superseded  by  "Air  Force  Resource  and  Management  Issues  in  the  1980s"  in 
the  Resource  Management  Program. 

While  this  report  was  in  preparation,  Lieutenant  Colonel  H.  P. 

Romanoff,  USAF,  was  on  duty  in  the  System  Sciences  Department  of  The 
RAND  Corporation.  At  present,  he  is  with  the  Directorate  of  Advanced 
Programs  in  the  Office  of  the  Assistant  Secretary  of  the  Air  Force  for 
Acquisition . 
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SUMMARY 


This  Note  presents  generalized  equations  for  estimating  the 
development  and  production  costs  of  fighter  aircraft  airframes.  It 
provides  separate  estimating  relationships,  in  the  form  of  exponential 
equations,  for  engineering,  tooling,  manufacturing  labor,  manufacturing 
material,  development  support,  flight  test,  and  quality  control  as  well 
as  for  total  program  cost.  The  estimating  relationships  have  been 
derived  from  a  database  consisting  of  17  fighters  with  first  flight 
dates  ranging  from  1948  to  1978.  The  aircraft  technical  data  were 
obtained  for  the  most  part  from  either  original  engineering  documents 
such  as  manufacturer's  performance  substantiation  reports  or  from 
official  Air  Force  and  Navy  documents.  The  cost  data  were  obtained  from 
the  airframe  manufacturers  either  directly  from  their  records  or 
indirectly  through  standard  Department  of  Defense  reports  such  as  the 
Contractor  Cost  Data  Reporting  System. 

For  each  airframe  cost  category  there  are  generally  several 
potentially  useful  estimating  equations.  Nevertheless,  a  single  set  of 
equations  has  been  selected  as  being,  in  our  judgment,  the  most 
representative  and  applicable  to  the  widest  range  of  estimating 
situations.  The  selection  rationale,  as  well  as  the  alternative 
equations  and  supporting  data,  are  presented  in  this  Note  so  that 
interested  readers  may  make  their  own  judgments. 

The  recommended  equation  set  uses  only  one  vnriable--airf raise  unit 
weight--and  is  based  on  a  subsample  consisting  of  six  post-1960 
fighters.  This  equation  set,  which  was  visually  fit  to  the  data, 
provides  results  that  wc  believe  to  be  more  credible  than  those  produced 
by  multiple  least-squares  regression  analysis  of  the  full  17  aircraft 
fighter  sample, 

With  the  exception  of  a  variable  that  distinguishes  the  older 
fighters  (which  were  es.sentially  gun  platforms)  from  the  more  modern 
fighters  with  sophisticated  fire  control  and  missile  armament,  our 

attempts  to  incorporate  construction  and  program  characteristics  wore 

I 

I 


not  successful.  Although  variables  characterizing  the  equipment  placed 
within  the  airframe  structure  were  frequently  found  to  be  statistically 
significant,  they  did  not,  as  a  rule,  result  in  any  substantial 
improvement  in  the  quality  of  the  equations.  In  most  cases,  the 
equations  incorporating  such  variables  did  not  produce  results  that  we 
viewed  as  credible.  Moreover,  even  in  those  few  instances  where  the 
equations  did  produce  credible  results,  the  reduction  in  the  standard 
error  of  estimate  was  never  more  than  two  or  three  percentage  points. 

A  comparison  of  the  recommended  fighter  equation  set  with  the  all¬ 
mission  sample  equation  set  (developed  in  N-2283/1-AF)  was  also 
undertaken.  In  terms  of  the  estimates  obtained  from  each  set  for  the 
F-4,  F-111,  F-14,  F-15,  F-16,  and  F-18,  we  found  that  the  fighter 
equation  set  will  produce  larger  estimates  than  the  all-mission  type 
equation  set  for  relatively  light,  "slow"  fighters  (e.g.,  the  F-16  and 
F-18)  and  smaller  estimates  for  relatively  heavy,  fast  fighters  (e.g., 
the  F-4,  F-111,  F-14,  and  F-15).  However,  using  the  average  absolute 
relative  derivations  of  the  six  post-1960  fighters  as  a  basis,  we  found 
that  the  fighter  equation  set  was  only  slightly  more  accurate  than  the 
all-mission  type  set  despite  the  focused  nature  of  the  fighter  database. 

The  ultimate  test  will,  of  course,  be  the  set's  ability  to  estimate 
the  cost  of  future  fighters.  Unfortunately  (from  an  estimating  point  of 
view),  airframes  are  changing  dramatically  with  rcr.p^rt  to  materials 
(e.g.,  more  extensive  use  of  composites),  design  concepts  (e.g., 
concepts  to  increase  fuel  efficiency  and  to  reduce  radar  cross-section), 
and  manufacturing  techniques  (e.g.,  use  of  computers  and  robots).  We 
believe  that  the  material  and  design  changes  will  act  to  increase  unit 
costs  but  we  arc  uncertain  about  the  net  impact  of  capital  equipment 
clianges  .  Jn  any  case,  it  is  highly  unlikely  that  any  of  the  equation 
sets  presented  in  this  document  will  overestimate  the  costs  of  future 
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AUW  Airframo  unit  weight  (lb) 

AVAUW  Hatlo  of  avionics  weight  to  airframe  unit  weight 
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BREG  Breguet  range  factor  (n.mi.) 

CA  Cumulative  average 

CARRDV  Carrier  capability  designator  (1  =  no;  2  -  yes) 

CLIMB  Rate  of  climb  (ft/min) 

DS  Development  support  cost  (thousands  of  3977  dollars) 

ENERGY  Maximum  specific  energy  (ft) 

ENGRj^qq  Cumulative  engineering  hours  for  100  aircraft  (thousands) 

ENGDV  New  engine  designator  (1  =  no;  2  =  yes) 

ENGLOC  Engine  location  designator  (1  =  embedded  in  fuselage;  2  = 

in  nacelles  under  wing) 

EXPDV  Contractor  experience  designator  (1  =  no;  2  =  yes) 

EW  Empty  weight  (lb) 

EWAUW  Ratio  of  empty  weight  less  airframe  unit  weight  to 

airframe  unit  weight 

FT  Flight  test  cost  (thousands  of  1977  dollars) 

Cumulative  manufacturing  labor  hours  for  100  aircraft 

(thousands) 

MATLj^qq  Cumulative  manufacturing  material  cost  for  100  aircraft 

(thousands  of  1977  dollars) 

PFFD  Predicted  first  flight  date  (months  since  January  1, 

1940) 
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PROG 


100 


Q 

^Q'^lOO 


SP 

SPCLS 

SPPWR 

STREFF 

SUSLD 

TESTAC 

THVT 

TOOLCP 

USELD 

ULTLD 

WTAREA 

WGTYPE 

WGWET 

WSDV 


Program  type  designator  (1  =  concurrent;  2  =  prototype) 

Cumulative  program  cost  for  100  aircraft  (thousands  of 
1977  dollars) 

Quantity 

Cumulative*  quality  control  hours  for  100  aircraft 
(thousands ) 

Maximum  speed  (kn) 

Speed  class  (1  =  less  than  Mach  .95;  2  -  Mach  .95  to 
1,94;  3  =  Mach  1.95  to  Mach  2.5;  4  -  greater  than  Mach 
2,5) 

Specific  power  (hp/lb) 

Structural  efficiency  factor 
Maximum  sustained  load  factor  (g's) 

Number  of  test  aircraft 
Thrust-to-weight  ratio 

Cumulative  tooling  hours  for  100  aircraft  (thousands) 
Maximum  tooling  capability  (aircraft  per  month) 

Useful  load  fraction 

Design  ultimate  load  factor  (g's) 

Wetted  area  (sq  ft) 

Wing  type  (1  =  straight;  2  =  swept;  3  =  delta;  4  = 
variable  sweep) 

Ratio  of  wing  area  to  wetted  area 
Weapon  system  designator  (1  =  no;  2  =  yes) 


EVALUATION  CRITERIA  NOTATION 


Notation 


Explanation 


EQ  SIG:  F-TEST 

EXP  MAG:  variable  ttinemonic 

EXP  SIGN:  variable  mnemonic 

F 

10:  aircraft  identification 

LDIFF:  variable  mnemonic 

MCOL:  rCvariable)  >  .7,  .8,  or  .9 

N 

RP:  CUR:  OVER/UNDER 

RP:  DIST 

SEE 


Equation  as  a  whole  is  not 
significant  at  5%  level  (based  on 
F-statistic) 

Question  exists  regarding  magnitude 
of  variable  exponent  (reasorableness) 

Sign  of  variable  exponent  does  not 
agree  with  a  priori  notions 

F-statistic 

Based  on  "Cook's  Distance,"  aircraft 
is  Indicated  to  be  influential 
observation 

Limited  differentiation  in  dummy 
variable;  coefficient  determined  by 
single  observation  or  portion  of 
dummy  variable  range  not  Included  in 
a  subsample 

Indicates  degree  of  intercorrelation 
of  specified  variable  with  other 
equation  variables  (only  provided 
when  threshold  of  .7  is  exceeded) 

Number  of  observations 

Coefficient  of  determination 

Residual  pattern  Indicates  that  the 
most  recently  developed  aircraft  in 
the  sample  are  over  or  underestimated 

Residual  pattern  Indicates  that  the 
error  is  not  normally  distributed 
with  zero  mean  and  constant  variance 

Standard  error  of  estimate 


VAR  SIG:  variable  mnemonic  Variable  is  not  significant  at  the  5% 

level  (t-statistic) ' 


^Variable  significance  is  provided  in  parentheses  beneath  each 
variable. 
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I.  INTRODUCTION 


Parametric  models  for  estimating  aircraft  airframe  acquisition 
costs  have  been  used  extensively  in  advanced  planning  studies  and 
contractor  proposal  validation.  These  models  are  designed  to  be  used 
when  little  is  known  about  an  aircraft  design  or  when  a  readily  applied 
validity  and  consistency  check  of  detailed  cost  estimates^  is  necessary. 
They  require  inputs  that:  (a)  will  provide  results  that  are  relatively 
accurate;  (b)  are  logically  related  to  cost;  and  (c)  can  easily  be 
projected  prior  to  actual  design  and  development.  The  intent  is  to 
generate  estimates  that  include  the  cost  of  program  delays,  engineering 
changes,  data  requirements,  and  phenomena  of  all  kinds  that  occur  in  a 
normal  aircraft  program. 

Since  1966,  RAND  has  developed  three  parametric  airframe  cost 
models.*  These  models  have  been  characterized  by:  (a)  easily 
obtainable  size  and  performance  inputs  (weight  and  speed);  (b)  the 
estimation  of  costs  at  the  total  airframe  level;  and  (c)  the  utilization, 
of  heterogeneous  aircraft  samples.  They  have  normally  been  updated  when 
a  sufficient  number  of  additional  aircraft  data  points  has  become 
available  to  suggest  possible  changes  in  the  equations.  Such  is  the 
case  with  the  present  effort:  the  A-10,  F-15,  F-16,  F-18,  F-101,  and 
S-3  aircraft  have  been  added  to  the  full  estimating  sample.’ 

In  addition  to  the  expansion  of  the  database,  we  also  examined; 

(a)  the  utility  of  dividing  the  estimating  sample  into  .subsamples 
representing  major  differences  in  aircraft  type  (attack,  fighter, 
bomber/transport);  (b)  the  explanatory  power  of  variables  describing 

’Examples  of  this  latter  application  include  the  Independent  Cost 
Analysis  (ICA)  prepared  as  part  of  the  Defense  Systems  Acquisition 
Review  Council  (DSARC)  process  and  government  analyses  of  contractor 
cost  proposals  during  source  selections. 

*See  Refs .  1,  2,  and  3, 

’Additionally,  the  F-86,  F-89,  and  F3D,  which  were  dropped  from  the 
DAPCA-III  estimating  sample,  were  reintroduced. 
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program  structure  and  airframe  construction  techniques;  and  (c)  the 
possible  benefits  of  incorporating  an  objective  technology  measure  into 
the  fighter  sample  equations.  In  order  to  address  the  issue  of  sample 
homogeneity,  each  of  the  subsamples,  as  well  as  the  full  sample,  had  to 
be  investigated  in  detail  with  the  ultimate  goal  of  developing 
representative  sets'*  of  cost  estimating  relationships  (CERs)  for  each. 
The  purpose  of  this  Note  is,  therefore,  to  document  the  selection  of  a 
representative  set  of  CERs  for  the  fighter  subsample. 

A  detailed  description  of  the  overall  study,  including  the  research 
approach,  evaluation  criteria,  and  database,  may  be  found  in  the 
comipanion  Report,  R-3255-AF,  Aircraft  Airframe  Cost  Estimating 
Relationships i  Study  Approach  and  Conclusions . 

APPROACH  AND  PRINCIPAL  RESULTS 

Our  analysis  examined  a  large  number  of  potentially  useful 
equations  for  each  of  the  airframe  cost  elements.  In  fact,  this  report 
contains  each  of  the  231  equations  that  met  our  initial  screening 
criterion  relative  to  variable  significance  (discussed  in  Section  II). 
Additionally,  data  plots  have  been  Included  for  each  cost  element. 
Presenting  such  a  large  number  of  equations  and  supporting  data  serves 
two  purposes.  First,  the  information  contained  in  the  equations  and 
plots  can  provide  an  improved  understanding  of  the  factors  that 
influence  airframe  costs.  Thus,  the  estimator  will  have  a  more  complete 
context  in  which  to  judge  the  applicability  of  specific  estimating 
equations.  Second,  we  are  offering  the  user  alternatives  for  each  cost 
element  that  may  be  better  suited  in  a  particular  case  than  any  single 
equation  that  we  might  have  selected  if  we  chose  to  document  just  one. 
This  is  important  since,  in  general,  the  study  did  not  produce  one 
equation  for  each  cost  element  that  is  clearly  preferred  over  all 
others.  The  user  should  review  all  of  the  results  before  selecting  the 
equations  to  be  used  in  a  particular  situation. 

‘‘A  set  encompasses  the  following  cost  elements:  engineering, 
tooling,  manufacturing  labor,  manufacturing  material,  development 
support,  flight  test,  and  quality  control. 
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The  basic  estimating  sample  used  in  our  analysis  consists  of 
fifteen  "new  design"  fighter  aircraft  with  first  flight  dates  ranging 
from  1948  to  1972:  F3D,  F3H,  F4D,  F-4,  F-14,  F-15,  F-86,  F-89,  F-lOO, 
F-101,  F-102,  F-104,  F-105,  F-106,  and  F-111.'  All  technical  data  were 
obtained  from  either  original  engineering  documents  or  from  official  Air 
Force  or  Navy  aircraft  characteristics  summaries. 

Our  analysis  of  the  basic  15-aircraft  estimating  sample  led  to  the 
derivation  of  what  we  felt  to  be  a  reasonably  representative  set  of 
CERs,  The  estimating  relationships,  which  were  visually  fit  to  the 
data,  were  based  on  a  subsatnple  of  the  basic  sample  consisting  only  of 
those  fighters  with  post-1960  first  flight  dates  (the  F-4,  F-111,  F-14, 
and  F-15).  The  decision  to  use  the  more  limited  group  of  fighters  was 
the  result  of  observations  made  during  the  course  of  the  study  that 
raised  questions  concerning  the  applicability  of  some  of  the  older 
fighters  in  the  sample  to  fighters  of  the  future.  Wo  concluded  that  the 
more  limited  post-1960  experience  would  be  a  better  guide  to  the  future. 

Subsequent  to  the  completion  of  the  analysis  of  the  basic  sample, 
but  prior  to  the  publication  of  this  Note,  however,  cost  data  for  the 
F-16  and  F-18  became  available.  Consequently,  we  reexamined  the  cost 
scattergrams  (updated  to  include  the  F-16  and  F-18)  to  see  whether  any 
changes  in  the  visually  fit  equations  wore  suggested.  As  a  result  of 
this  reexamination,  we  made  relatively  minor  modifications  to  two  of  the 
estimating  relationships  (labor  and  material).  The  final  recommended 
set  of  fighter  airframe  CERs,  which  incorporates  these  modifications,  is 
provided  in  Table  1.  The  fighters  that  served  as  the  basis  for  the 
equations  have  characteristic  values  that  span  the  ranges  shown  below. 


Characteristic 


Post-1S60 
Database  Range 


Airframe  unit  weight  (lb) 

Empty  weight  (lb) 

Speed  (knots) 

Number  of  flight  test  aircraft 


9,565  -  33,150 

14,062  -  46,170 

1,0004-  -  1,2504- 

7  -  20 


“The  F-16  and  F-10  were  not  a  part  of  the  basic  estimating  sample 
but,  as  will  be  explained  subsequently,  were  incorporated  into  our 
analysis  prior  to  the  publication  of  this  Note. 
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Table  1 


RECOMMENDED  SET  OF  FIGHTER  AIRFRAME  CERs 
(Based  on  post-1960  fighters) 


.887 

ENGR 

=  2.31 

AUW 

100 

.883 

TOOL 

=  1.38 

AUV.' 

100 

.678 

LABR 

=  25.4 

AUW 

100 

.878 

MATL 

=  43.3 

AUW 

100 

DS  =  .75  *  ENGRC 

1 

.687 

FT  =27100  TESTAC 

QC  =  .142  *  LADR 

100 

.812 

PROG  =  550  AUW 

100 

AUW  =  airframe  unit  weight  (lbs) 

DS  =  development  support  cost  (thousands  of  1977  dollars) 

ENGR  “  cumulative  engineering  hours  for  100  aircraft  (thousands) 

100 

ENGRC  =  nonrecurring  engineering  cost  (thousands  of  1977  dollars)(a) 

1 

FT  =  flight  test  cost  (thousands  of  1977  dollars) 

LABR  =  cumulative  manufacturing  labor  hours  for  100  aircraft 

100  (thousands) 

MATL  =  cumulative  manufacturing  material  dollars  for  100  aircraft 
100  (thousands  of  1977  dollars) 

QC  =  cumulative  quality  control  hours  for  100  aircraft  (thousands) 

100 

PROG  =  cumulative  total  program  cost  for  100  aircraft  (thousands  of 
100  1977  dollars) 

TESTAC  =  number  of  flight  test  aircraft 

TOOL  =  cumulative  tooling  hours  for  lOO  aircraft  (thousands) 

100 

_  ^ 

(a)ENGRC  =  $27, 70  *  ENGR  *  100  where  the  factor  100  is 

1  100 

used  to  adjust  cumulative  engineering  hours  from  a  quantity  of  100  to  a 
quantity  of  1  (assuming  a  112%  cumulative  total  slope)  and  where 
$27.50  represents  the  fully  burdened  engineering  hourly  labor  rate  in 
1977  dollars, 


In  order  to  adjust  the  quantity-dependent  estimating  relationships 
to  quantities  other  than  100,*  the  following  slopes  are  recommended: 

Cumulative  Total  Cumulative  Total 


Slope  (%)  Exponent 

Engineering  112  ,163 
Tooling  120  .263 
Manufacturing  labor  158  .660 
Manufacturing  material  166  .231 
Quality  control  164  .714 
Total  program  cost  128  .356 


The  manufacturing  material,  development  support,  flight  test,  and 
total  program  cost  categories  are  all  estimated  directly  in  1977 
dollars.  In  order  to  convert  the  remaining  cost  categories  that  are 
estimated  in  manhours  to  1977  dollars,  the  following  fully  burdened 
hourly  labor  rates  are  suggested: 


Engineering 

27.50 

Tooling 

25.50 

Manufacturing  labor 

23.50 

Quality  control 

24.00 

For  estimates  in  1986  dollars,  the  following  hourly  labor  rates  and 
adjustment  factors  are  suggested: 


Engineering  59.10 
Tooling  60.70 
Manufacturing  labor  50.10 
Quality  control  55.40 
Manufacturing  material  (index)  1.94 
Development  support  (index)  1.94 
Flight  test  (index)  1.94 
Total  program  cost  (index)  2.13 


‘'Cost(Q  )  =  Cost(lOO)  *  (Q 

new  new 


NOTE  ORGANIZATION 


Section  II  provides  brief  descriptions  of  the  database  and 
statistical  analysis  methods.  Section  III  provides  an  initial  overview 
of  the  individual  cost  element  analyses  that  follow.  Sections  IV 
through  XI  provide--by  coat  element — data  plots,  estimating  relationships 
meeting  our  initial  screening  criterion,  and  the  rationale  for  selection 
of  "representative"  equations.’  Section  XII  explains  the  selection  of 
the  recommended  equation  set.  Section  XIII  details  the  incorporation  of 
the  F-16  and  F-18  data.  Finally,  Sec.  XIV  summarizes  the  main  findings 
of  the  analysis. 

Two  appendixes  contain  miscellaneous  supporting  information. 

Appendix  A  contains  correlation  matrices.  Appendix  B  contains 
calculated  costs  for  several  equation  sets  for  the  F-4,  F-111,  F-14,  and 
F-15. 


’As  stated  previously,  the  detailed  analysis  was  not  repeated  when 
the  F-16/F-18  data  were  obtained.  Therefore,  Secs.  II-XII  are  based  on 
the  15-aircraft  estimating  sample,  which  does  not  include  the  two  most 
recent  fighters. 


II.  DATABASE  AND  ANALYTICAL  APPROACH 


As  stated  previously,  a  detailed  description  of  the  research 
approach,  evaluation  criteria,  and  database  for  this  study  may  be  found 
in  R-32S5-AF.  However,  in  order  that  this  Note  may  have  a  degree  of 
self-sufficiency,  a  synopsis  of  the  database  and  analytical  approach  is 
presented  prior  to  the  reporting  of  results. 


ESTIMATING  SAMPLE 

The  cost  data  used  in  this  study  have  been  obtained  from  both 
government  and  industry  sources.  The  "basic"  fighter  sample  consists  of 
the  following  15  "new  design"  aircraft: ‘ 


Modal 

First  Flight 
Date* 

F-86 

1943 

F3D 

1950 

F-89 

1950 

F-lOO 

1953 

F4D 

1954 

F-101 

1954 

F3H 

1955 

F-102 

1955 

F-104 

1956 

F-105 

1956 

F-106 

1956 

F-4 

1961 

F-111 

1967 

F-14 

1970 

F-15 

1972 

‘The  classification  of  an  aircraft  as  new  or  derivative  is  not  an 
entirely  objective  procedure.  For  example,  although  the  F-102A  program 
laid  the  groundwork  for  the  F-106A,  the  F-106A  is  classified  as  a  new 
design  in  the  database  because,  in  contrast  to  the  F-102A,  it  had  a  new 
engine,  relocated  air  Intakes,  variable  geometry  air  inlets,  a  modified 
vertical  stabilizer  and  markedly  better  performance.  (Ref.  4,  p,  14.) 

*The  first  flight  dates  presented  in  this  report  are  intended  to 
reflect  the  first  flight  date  of  the  version  of  the  aircraft  that  was 
most  representative  of  the  aircraft  that  was  to  become  operational.  Put 
another  way,  these  dates  are  intended  to  reflect  the  first  flight  date 
of  the  developmental  aircraft  and  not  earlier  experimental  or  prototype 
aircraft.  Thus,  although  the  F-4A  aircraft  first  flew  in  May  1958,  the 
first  flight  date  of  the  F-4B  aircraft  is  presented. 
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DEPENDENT  VARIABLES 

Costs  have  been  dealt  with  at  both  the  total  program  level*  and  at 
the  major  cost  element  level  (engineering,  tooling,  manufacturing  labor, 
manufacturing  material,  development  support,  flight  test,  and  quality 
control ),“*  The  relative  importance  of  various  cost  categories  is  shown 
in  Table  2  for  four  alternative  production  quantities.  Other  things 
being  equal,  the  analyst  would  obviously  hope  that  the  estimating 
relationship  for  manufacturing  labor  was  the  most  accurate  because  of 
its  relatively  large  contribution  to  program  cost. 

Engineering,  tooling,  manufacturing  labor,  and  quality  control  are 
estimated  in  terms  of  manhours  rather  than  dollars  for  two  reasons:  (a) 
it  avoids  the  need  to  make  adjustments  for  annual  price  changes,  and  (b) 
it  permits  comparison  of  real  differences  in  labor  requirements.* 
Manufacturing  material,  development  support,  and  flight  test  do  not  lend 
themselves  to  this  approach  and  were  therefore  estimated  in  terms  of 
dollars  (in  this  case,  constant  1977  dollars). 


i 


Table  2 

PERCENTAGE  BREAKDOWN  OF  FIGHTER  AIRFRAME  PROGRAM  COSTS 
(15 -Aircraft  Average  Costs) 


Cost  Element 

Quantity 

25  50  100 

200 

Engineering 

25 

23 

20 

17 

Tooling 

16 

16 

15 

14 

Manufacturing  labor 

22 

27 

32 

36 

Manufacturing  material 

B 

10 

13 

17 

Development  support 

13 

10 

8 

5 

Flight  test 

14 

11 

8 

6 

Quality  control 

2 

3 

4 

5 

100% 

100% 

100% 

100% 

’Total  program  costs  arc  "normalized"  values  and  not  the  actual, 
reported  dollar  amounts.  They  are  normalized  in  the  sense  that  the 

dollar  amounts  for  engineering,  tooling,  manufacturing  labor,  and  •, 

quality  control  have  been  determined  by  applying  fully  burdened, 
industry-average  labor  rates  to  the  hours  reported  for  each  category. 

‘‘Cost  element  definitions  are  provided  in  Appendix  A  of  R-3255-AF. 

*The  major  limitation  of  the  manhour  approach  is  that  it  does  not 
account  for  differences  In  overhead  rates.  Consequently,  differences  in 
such  things  as  capital/ labor  r.i ios  cannot  be  addressed.  •! 
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POTENTIAL  EXPLANATORY  VARIABLES 

In  order  to  have  been  included  among  the  characteristics  that  were 
considered  for  inclusion  in  the  CERs,  the  following  requirements  must 
have  been  fulfilled: 

1.  The  variable  had  to  be  logically  related  to  cost:  that  is,  a 
rationale  had  to  be  constructed  that  would  explain  why  cost 
should  be  Influenced  by  the  variable. 

2.  The  variable  had  to  bo  one  that  was  "readily  available"  in  the 
early  stages  of  aircraft  conceptualization. 

3.  The  variable  had  to  have  an  available  historical  record. 

During  the  formulation  stage  of  this  study,  28  aircraft 
characteristics  were  identified  as  potential  explanatory  variables  for 
the  fighter  sample  CERs.  Values  for  these  characteristics,  which  are 
grouped  into  four  general  categories®«-size,  performance,  construction, 
and  program--are  provided  in  Table  3.  As  indicated,  the  only  variable 
whose  minimum  and  maximum  values  span  a  range  of  over  an  order  of 
magnitude  is  climb  rate.  Additionally,  there  is  no  variation  in  the 
engine  location  designator--all  fighters  have  engines  mounted  in  the 
fuselage . 

There  are,  of  course,  differences  that  are  not  accounted  for  in 
Table  3  between  the  aircraft.  Some  of  the  differences  between  the 
aircraft  relate  to  the  way  an  aircraft  is  constructed  (materials, 
manufacturing  technology),  others  to  the  way  the  program  is  managed.  In 
any  case,  it  is  difficult  to  find  an  aircraft  without  at  least  one 
unique  aspect.  Therefore,  the  following  list  is  intended  only  to  be 
indicative  of  the  types  of  differences  that  are  difficult  to  account  for 
in  a  generalized  parametric  model. 


AIRCRAFT  CHARACTERISTIC  VALUES 
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•  The  F-86  was  the  first  swept  wing  aircraft. 

•  The  F-lOO  was  the  first  aircraft  capable  of  sustained 
supersonic  flight. 

•  The  F4D  was  the  first  operational  delta  wing  aircraft. 

•  The  F-102  did  not  meet  its  speed  performance  specifications 
until  after  a  major  redesign. 

•  The  F-104  was  the  first  operational  Mach  2+  aircraft. 

•  The  F-106  was  a  design  outgrowth  of  the  F-102. 

•  The  F-4  design  evolved  (during  the  original  development  phase) 
from  a  single-seat,  attack  aircraft  with  four  20-mm  cannons  to 
a  high-altitude  Interceptor  with  two  crew  positions  and  missile 
armament . 

•  The  F-111  was  the  first  aircraft  for  which  common  Air 
Force/Navy  usage  was  made  a  requirement  at  inception. 

A  priori  notions  regarding  the  effect  an  increase  in  the  value  of 
an  explanatory  variable  might  have  on  each  of  the  cost  elements  are 
indicated  in  Table  4.  A  plus  indicates  a  positive  effect;  a  minus  a 
negative  effect.  An  effect  that  was  thought  to  be  negligible  is 
indicated  by  a  blank  while  an  uncertain  effect  is  indicated  by  a 
question  mark. 

TECHNOLOGY  INDEX 

Recent  RAND  work’  has  resulted  in  the  development  of  an  expression 
that  relates  the  time  of  appearance  of  an  aircraft  design  to  its  level 
of  performance,  which  is  interpreted  as  a  measure  of  its  level  of 
technological  sophistication.*  The  expression- -which  includes  specific 
power,  the  Breguet  range  factor,  sustained  load  factor,  fuel  fraction, 
and  a  carrier-capability  designator--is  represented  in  Fig.  1. 

’See  Ref.  4. 

*It  should  be  noted  that  in  addition  to  the  technology  index 
itself,  another  benefit  of  the  technology  study  to  this  analysis  was  the 
identification  of  several  individual  explanatory  variables  that  had  not 
previously  been  tested  for  significance  in  airframe  cost  equations. 
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Table  4 

A  PRIORI  NOTIONS  REGARDING  EFFECT  OF  INCREASE  IN 
EXPLANATORY  VARIABLE  ON  COST  ELEMENT 


Mfg 

Hlg 

Dav 

Plight 

Quality 

Total 

Explanitory  Variabla 

Kngr 

Tooling 

Labor 

Hatl 

Support 

Taat 

Control 

Progran 

Site 

Alrfraaw  unit  weight  (AUV) 

+ 

4* 

4 

4 

4 

4 

4 

4 

Eapty  walght  (EW) 

+ 

+ 

4 

4 

4 

4 

4 

4 

Vat  tad  araa 

+ 

+ 

4 

4 

4 

4 

4 

4 

Tachnlcal/FarfoMnea 

Kaxlnum  apaad* 

+ 

+ 

4 

4 

4 

4 

4 

4 

Spaad  olaia 

■f 

4 

4 

4 

4 

4 

4 

Spaelflc  pewar 

•f 

+ 

4 

4 

4 

4 

4 

4 

Haxlaum  apaelflo  anargy 

+ 

4 

4 

4 

4 

4 

4 

Cliab  rata 

+ 

+ 

4 

4 

4 

4 

4 

4 

Hasious  auatalnad  load  factor 

+ 

4 

4 

4 

4 

4 

4 

4 

Thruat-to-valght  ratio 

+ 

+ 

4 

4 

4 

4 

4 

4 

Braguat  ranga  factor 

+ 

+ 

4 

■i‘ 

4 

Uaaful  load  fraction 

+ 

4 

4 

4 

4 

Pradietad  firat  flight  data 

Ctachnology  Indaa) 

Pradietad  firat  flight  data 

+ 

4 

4 

4 

Ccoapoalta  parforaincc) 

+ 

4 

4 

4 

4 

4 

4 

4 

Conitructlan 

Daaign  ultimata  load  factor  . 

4 

4 

4 

4 

Strvittural  afflelancy  factor" 

- 

• 

- 

• 

Carrlar  capability  daalgnator" 

+ 

4 

+ 

4 

4 

4 

Englna  location  daalinator'* 

Ulng  typa  daslgnator* 

- 

7 

•• 

+ 

7 

+ 

4 

4 

4 

4 

4 

Patio  of  wing  araa  to  wattad  araa 

- 

- 

Ratio  of  (EW-AUW!) /AUW 

4 

4 

4 

+ 

4 

4 

Patio  of  avlonlct  walght  to  AUW 

♦ 

4' 

4 

4 

4 

+ 

4 

Puaditr  of  black  boxaa 

4 

4 

4 

4 

4 

4 

Prog ran 

Nuabar  of  taat  aircraft 

Maximum  toollDg  capability 

+ 

« 

4 

7 

Haw  angina  datljnatoru  . 

+ 

4 

4 

Contractor  axparlanca  daalgnatur' 

+ 

4 

4 

4 

4 

4 

4 

4 

Waapon  ayatam  dialgnator^ 

4 

4 

4 

+4 

4 

Program  typa  daaignatorS 

7* 

7* 

7^ 

7^ 

7^ 

Spaad  claifi  1  •  laia  than  Mach 

.95;  2  -  Mach 

.95  to 

Mach  1.94; 

3  - 

Mach  1.95 

to  Harii  2, 

, 5j  4  •  graatar 

than  Mach  2.5. 


^Low  valuai  arc  nara  difflr.ulc  to  achiav*. 

So  -  1/Y«i  ■  2. 

^Enflna  location i  aubaddad  In  fuaalaga  «  1}  In  nacalloa  undar  wing  »  2, 

Sing  typaat  1  "  etralght{  2  «■  avapt^  3  •  dalta)  4  •  variabla  awaap. 

Saa  ■  1/No  -  2. 

^Concurrant  ■»  l/Vtototypa  •  2. 

^Ovar  toajor  aaacmbly  labor  houra  have  tandad  to  dacraaaa  bacauaa  of  improvamuiitia  in  mamifauturlng 

vathodi  (a«gi|  unltiiad  deaign)  vhila  fabrication  labor  houra  hava  tended  to  Increaaa  bncauia  of  Intro¬ 
duction  of  titanium  and  cotepuaita  matarlala.  Th«  net  affect  haa  baan  a  dacraaaa  in  inatiuf acturing  lioura. 

Sot  known  whathar  total  coat  (prototype  effort  plua  full-acala  davelopmant)  for  prototype  program  la 
graattr  or  leas  than  for  concurrent  progrra. 


a 


•J 


a. 


Calculated  first  flight  date  (year) 


Brtpjet 


Thruat  -  ' 

+  1.768 

range 

factor 

1.186 

■  Sustained  - 
load  factor 

100W,b, 

10,000 

10 

t.  J 

. 

L  -1 

-t-  .026 


r  Toul  1 
fuel 

fraction 


.168 


Carrier 

cipabllity 


NOTE:  t  -  calculated  lint  flight  date  meaiured  in  monthi  lince  January  1,  1940. 
Thruit  meatured  in  pounda,  in  knoU,  combat  weight  in  pounda,  Carrier  capability 
variable:  1  denotea  no  capability,  0  denotea  capability. 


Fig.  1— Multivariate  technology  trend  for  new  fighter  designs 
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The  vertical  axis  measures  the  first  flight  date  calculated  by 
inserting  aircraft  performance  parameters  in  the  technology 
equation  and  the  horizontal  axis  measures  the  actual  first 
flight  date  for  each  aircraft.  The  distribution  of  the  25 
data  points  about  the  45  degree  line  provides  one  measure  of 
how  well  the  equation  fits  the  data  sample.  Points  plotted 
above  the  45  degree  line  represent  aircraft  that  flew  earlier 
than  the  date  predicted  by  the  equation,  and  the  converse 
holds  for  points  plotted  below  the  line.  The  magnitude  and 
sign  of  the  residual  of  the  technology  equation  determine 
where  a  particular  aircraft  point  falls  relative  to  the  45 
degree  trend  line,  with  the  residual  representing  all  the 
unquantif iable  factors  that  Influence  when  the  first  flight  of 
an  aircraft  occurs,  including  technological  factors  not 
covered  by  the  independent  variable  parameter  set,  scheduling 
decisions.  Congressional  and  service  funding  decisions, 
development  philosophy,  etc.  Accordingly,  one  should 
interpret  the  results  from  the  equation  only  as  a  gross 
indication  of  average  technological  trends  in  fighter  aircraft 
development,  remembering  that  other  factors  can  also  influence 
the  time  at  which  a  particular  level  of  technology  becomes 
available. * 


APPROACH 

Potential  explanatory  variables  have  been  divided  into  four  general 
categories-“size,  performance,  construction,  and  program  (see  Table  4). 
As  discussed  in  R-3255-AF,  the  "ideal"  airframe  cost-estimating 
relationship  would  Incorporate  one  explanatory  variable  from  each 
category.  Thus,  there  would  be  four  Independent  variables  per 
estimating  relationship.  For  the  basic  all-mission  type  estimating 
sample,  which  has  32  observations,  the  possible  incorporation  of  four 
independent  variables  presents  no  difficulties  since  there  would  still 
be  27  degrees  of  freedom  left  with  which  to  estimate  the  error  term. 
Unfortunately,  the  basic  fighter  subsaniple  has  only  15  observations  and 
the  incorporation  of  four  explanatory  variables  would  leave  only  10 
degrees  of  freedom  with  which  to  estimate  the  error  term.  This  is  less 
than  half  the  comparable  value  for  the  full  estimating  sample. 
Consequently,  it  is  our  judgment  that  the  potential  number  of 
independent  variables  per  equation  should  be  limited  to  a  value  less 

*See  Ref.  4,  p.  27. 
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than  4.  On  the  other  hand,  the  boraber/transport  and  attack  aircraft 
subsamplos,  which  have  only  eight  and  seven  observations,  respectively, 
are  limited  to  two  variables  per  equation.  Therefore,  in  order  to  stay 
between  the  two  extremes,  the  number  of  explanatory  variables  considered 
per  equation  for  the  fighter  sample  was  tentatively  limited  to  three.'" 

With  respect  to  the  specific  combinations  of  variable  categories  to 
be  examined,  it  is  our  understanding  that  all  airframe  manufacturers  use 
some  measure  of  size  (usually  weight)  as  their  basic  scaling  dimension 
in  developing  cost  estimates  (although  other  factors  frequently  do  enter 
in).  Consequently,  it  does  not  seem  unreasonable  for  a  similar 
assumption  to  be  made  on  our  part--a  size  variable  must  appear  in  all 
equations  (except  for  flight  test  in  which  case  the  number  of  test 
aircraft  was  the  mandatory  variable).  Therefore,  with  this  additional 
restriction,  the  specific  variable  combinations  to  be  examined  for  the 
total  sample  are  as  follows; 

Size 

Size/per formanco 
Size/ construct ion 
Size/program 

Size/per formance/constructlon 
Size/performance/program 
Size/per formance/techno logy  index 

An  additional  complication  arose  from  the  fact  that  we  were  not 
developing  a  single  CER  but  rather  a  set  of  f'ERs.  Normally,  the 
development  of  a  representative  set  of  CERS  would  require  the  selection 
of  the  "best"  equation  for  each  cost  element.  However,  past  experience 
indicates  that  in  so  doing  the  resulting  equation  set  would  contain 
different  size  and  performance  variables  (e.g.,  airframe  unit 
weight/speed  and  empty  weight/climb  rate).  Such  a  result  would  put  the 
I  analyst  in  the  unenviable  position  of  trying  to  explain  why  a  given 

size/performance  variable  combination  predicts  cost  more  accurately  for 

'“We  do  not  mean  to  suggest  that  this  limit  is  an  "absolute" 
maximum  for  it  is  not  (theoretically,  one  could  use  13  explanatory 
I  variables  for  a  fighter  equation  and  still  have  one  degree  of  freedom 

left).  It  simply  reflects  'Ur  judgment  regarding  an  appropriate  balance 
between  sample  size  and  the  potential  number  of  explanatory  variables . 


i 
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one  cost  element  while  another  size/performance  variable  combination 
predicts  cost  more  accurately  for  another  cost  element.  Furthermore, 
because  of  variable  interaction  (e.g. ,  such  as  between  speed  and  rate  of 
climb),  the  user's  input  task  would  become  more  difficult.  On  the  other 
hand,  there  is  nothing  to  say  that  such  mixing  of  the  size  and 
performance  variables  could  not  in  fact  be  the  preferred  solution. 
Consequently,  two  types  of  equation  sets  were  developed;  one  that 
maintains  the  integrity  of  the  set  size  and  performance  variables  and 
one  that  utilizes  the  "best"  equation  for  each  cost  element  regardless 
of  the  size  or  performance  variables. 

The  first  step  in  developing  a  representative  set  of  CERs  was  to 
identify  all  potentially  useful  estimating  relationships  for  each  cost 
element  resulting  from  the  variable  combinations  listed  above.  For  this 
first  stop,  "potentially  useful"  included  only  those  estimating 
relationships  in  which  all  equation  variables  were  significant  at  the  5 
percent  level.  For  the  one-  and  two-variable  combinations,  all  possible 
equations  were  examined.  An  initial  inspection  v;as  next  undertaken  in 
order  to  identify  the  "most  promising"  of  the  size/performance 
combinations.  Then,  for  the  three-variable  combinations,  each  of  the 
construction  and  program  variables  was  examined  in  conjunction  with  the 
"most  promising"  of  the  size/performance  variable  combinations. 

Each  equation  satisfying  the  initial  screening  criterion  (5  percent 
variable  significance)  was  then  scrutinized  in  accordance  with  a  set  of 
evabiation  criteria  dealing  with  statistical  quality  and  reasonableness 
of  results  (these  are  described  in  a  subsequent  subsection) . 

The  next  step  was  to  develop  the  two  types  of  alternative  equation 
sets  discussed  previously.  For  the  first  type,  this  consisted  of 
selecting  the  "best"  estimating  relationship  for  each  of  the  "most 
promising"  size/performance  combinations  for  each  cost  element.  For  the 
second  type,  it  consisted  of  selecting  the  single  "best"  estimating 
relationship  for  each  cost  element.  Generally  speaking,  we  tried  to 
select  estimating  relationships  that  satisfied  the  following  conditions: 
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•  each  variable  significant  at  the  5  percent  level 

•  variables  taken  collectively  significant  at  the  5  percent  level 

•  produce  credible  results 

•  free  of  unusual  residual  patterns 

Once  these  conditions  were  satisfied,  the  objective  was  minimization  of 
the  standard  error  of  estimate.  Traditionally,  cost  analysts  have  tried 
to  achieve  a  standard  error  of  estimate  of  +  or  -20  percent  or  better. 
For  logarithmic  models,  this  is  approximately  equivalent  to  0.18  (-16 
percent,  +20  percent). 

The  final  step  was  the  selection  of  a  "most"  representative  set. 
This  final  selection  was  done  primarily  on  the  basis  of  a  comparison  of 
the  individual  equation  standard  errors  of  estimate  and  by  how  well  (in 
terms  of  relative  deviation)  the  sets  as  a  whole  estimated  the  costs  of 
a  subsample  of  four  recent  aircraft. 

Multiple  regression  analysis  was  used  to  examine  the  relationship 
between  cost  and  the  explanatory  variables.  Because  of  time 
restrictions,  only  one  equation  form  was  lnvestigated--logarithmic- 
llnear.  The  linear  model  was  rejected  because  its  main  analytic 
property-constant  returns  to  5cale--doe5  not  correspond  to  real  world 
expectations.  Of  the  two  remaining  equation  forms  considered 
(logarithmic  and  exponential),  the  logarithmic  model  seemed  most 
appropriate  for  the  cost-estimation  process  since  ■'t  minimizes  relative 
errors  rather  than  actual  errors  as  in  the  exponential  model. 

Cost  element  categories  that  are  a  function  of  quantity  were 
examined  at  a  quantity  of  100.  Developing  the  estimating  relationships 
at  a  given  quantity  rather  than  utilizing  quantity  as  an  independent 
variable  in  the  regression  analysis  avoids  the  problem  of  unequal 
representation  of  aircraft  (caused  by  unequal  numbers  of  lots). 


I 
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EVALUATION  CRITERIA 

The  estimating  relationships  obtained  in  this  analysis  were 
evaluated  on  the  basis  of  their  statistical  quality,  intuitive 
reasonableness,  and  predictive  properties. 

Statistical  Quality 

Variable  Significance.  Variable  significance  was  utilized  as  an 
initial  screening  device  to  reduce  the  number  of  estimating 
relationships  requiring  closer  scrutiny.  Normally,  only  those  equations 
for  which  all  variables  were  significant  at  the  5  percent  level  (one¬ 
sided  t-test)  were  reported  in  this  Note.  Occasionally,  however,  this 
criterion  was  relaxed  in  order  that  a  useful  comparison  could  be 
provided  or  so  that  the  requirement  concerning  the  integrity  of  the  set 
size  and  performance  variables  could  be  examined.  When  an  equation  is 
reported  for  which  not  all  equation  variables  are  significant  at  the  5 
percent  level,  it  is  denoted  as  follows: 

VAR  SIG:  variable  mnemonic 

2 

Coefficient  of  Determination.  The  coefficient  of  determination  (R  ) 
was  used  to  indicate  the  percentage  of  variation  explained  by  the 
regression  equation. 

Standard  Error  of  Estimate.  The  standard  error  of  estimate  (SEE) 
was  used  to  indicate  the  degree  of  variation  in  the  data  about  the 
regression  equation.  It  is  given  in  logarithmic  form  but  may  be 
converted  into  a  percentage  of  the  corresponding  hour  or  dollar  value  by 
performing  the  following  calculations: 


t 


(a) 

+SEE  , 
e  -1 

(b) 

+SEE  , 
e  -I 

« 


« 
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For  example,  a  standard  error  of  0.18  yields  standard  error  percentages 
of  +20  and  -16. 

F'Statistic.  The  F-statistic  was  used  to  determine  collectively 
whether  the  explanatory  variables  being  evaluated  affect  cost.  Those 
equations  for  which  the  probability  of  the  null  hypothesis  pertaining 
was  greater  than  0.05  have  been  identified  as  follows: 

EQ  SIG:  F-TEST 


Generally  speaking,  equations  so  Identified  were  not  considered  for 
inclusion  in  a  representative  equation  set. 

Multicollinearity .  Estimating  relationships  containing  variable 
combinations  with  correlations  greater  than  .70  are  identified  according 
to  the  degree  of  Intercorrelation: 

MCOL;  r(varlable  mnemonic)  >  .7,  .8,  or  .9 


where  the  variable  identified  in  parentheses  is  the  equation  variable 
showing  the  greatest  collinearlty .  Generally  speaking,  estimating 
relationships  with  intercorrelations  greater  than  .8  were  avoided,  when 
selecting  a  representative  equation  set. 

Residual  Plots.  Plots  of  equation  residuals  were  given  cursory 
examinations  for  unusual  patterns.  In  particular,  plots  of  residuals 
versus  predictions  (log/ log)  were  checked  to  make  sure  that  the  error 
term  was  normally  distributed  with  zero  mean  and  constant  variance. 
Additionally,  plots  of  residuals  versus  time  (log/linear)  were  examined 
to  see  whether  or  not  the  most  recent  airframe  programs  were  over-  or 
underestimated.  The  existence  of  such  patterns  resulted  in  one  of  the 
following  de.signations : 


RP:  DIST  (errors  not  normally  distributed) 

RP:  CUR:  OVER  or  UNDER  (most  recent  aircraft 

over-  or  underestimated) 


« 


Generally  speaking,  we  tried  to  avoid  the  use  of  estimating 
relationships  with  patterns  In  the  representative  equation  sets. 

Influential  Observations.  "Cook's  Distance"  was  utilized  to 
identify  influential  observations  in  the  least-squares  estimates.  For 
this  analysis,  an  influential  observation  was  defined  as  one  that  if 
deleted  from  the  regression,  would  move  the  least-squares  estimate  past 
the  edge  of  the  10  percent  confidence  region  for  the  equation 
coefficients.  Such  observations  are  identified  as  follows; 

10:  aircraft  identification 


When  an  observation  was  consistently  identified  as  influential,  it  was 
reassessed  in  terms  of  its  relevance  to  the  sample  in  question.  If  a 
reasonable  and  uniform  justification  for  its  exclusion  could  be 
developed,  then  the  observation  was  deleted  from  the  sample  and  the 
regressions  rerun  (in  actuality,  this  occurred  only  once--when  the  B-58 
was  deleted  from  the  bomber/transport  sample).  Otherwise,  the 
influential  observation  was  simply  flagged  to  alert  the  potential  user 
to  the  fact  that  its  deletion  from  the  regression  sample  would  result  in 
a  significant  change  in  the  equation  coefficients. 

Reasonableness 

The  development  of  airframe  cost-estimating  relationships  requires 
variable  coefficients  that  provide  both  credible  results  and  conform 
whenever  possible  to  the  normal  estimating  procedures  employed  by  the 
airframe  industry.  Such  credibility  and  conformity  are  reflected  in 
both  the  signs  of  the  variable  coefficients  as  well  as  their  magnitudes. 

Exponent  Sign.  Estimating  relationships  for  which  the  sign  of  the 
variable  coefficient  was  not  consistent  with  a  priori  notions  (see  Table 
4)  are  Identified  in  the  following  manner: 


EXP  SIGN:  variable  mnemonic 
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Estimating  relationships  containing  such  inconsistencies  were  not 
considered  for  inclusion  in  the  representative  equation  sets. 

Exponent  Magnitude.  Close  attention  was  also  paid  to  the 
magnitude  of  varj.able  coefficients.  This  applied  to  exponents  that  were 
felt  to  be  too  small  as  well  as  those  that  were  felt  to  be  too  large. 
Estimating  relationships  •containing  such  variable  coefficients  are 
identified  as  follows: 


EXP  MAG:  variable  mnemonic 

While  determinations  of  this  kind  are  largely  subjective,  there  was 
one  application  that  was  relatively  objective.  Traditionally,  size 
variables  have  always  provided  returns  to  scale  in  the  production- 
oriented  cost  elements  (tooling,  labor,  material,  and  total  program 
cost).  That  is,  increases  in  airframe  size  are  accompanied  by  less  than 
proportionate  Increases  in  cost.  If  the  opposite  phenomenon  is 
observed,  then  it  is  generally  believed  to  be  the  result  of  not 
adequately  controlling  for  differences  in  construction,  materials, 
complexity,  and/or  other  miscellaneous  production  factors. 

Consequently,  equations  possessing  a  size-variable  coefficient  greater 
than  one  were  always  flagged. 

When  selecting  a  representative  equation  set,  we  generally  tried  to 
avoid  estimating  relationships  containing  variables  with  exponents  that 
we  felt  were  either  too  b  .ge  or  too  small  (that  is,  exponents  that 
placed  either  too  much  or  too  little  emphasis  on  the  parameters  in 
question),  More  restrictlvely ,  for  the  production-oriented  cost 
elements,  no  estimating  relationship  possessing  a  size-variable  exponent 
greater  than  one  was  considered  for  a  representative  equation  set. 

Predictive  Properties 

Confidence  in  the  ability  of  an  equation  to  accurately  estimate  the 
acquisition  cost  of  a  future  aircraft  is  in  large  part  dependent  on  how 
well  the  acquisition  costs  of  the  most  recently  produced  aircraft  are 
estimated.  Normally,  statistical  quality  and  predictive  capability 


-  24 


would  be  viewed  as  one  and  the  same.  Unfortunately,  when  dealing  with 
airframe  costs  this  is  not  always  the  case  because  our  knowledge  of  what 
drives  airframe  costs  is  limited  and  because  the  sample  is  relatively 
small  in  size  and  not  evenly  distributed  with  respect  to  first  flight 
date  (see  Fig.  2) .  Consequently,  the  estimating  relationships  were  also 
evaluated  on  the  basis  of  how  well  costs  for  a  subset  of  the  most  recent 
aircraft  in  the  database  are  estimated. 

An  indication  of  an  equation's  predictive  capability  would  usually 
be  obtained  by  excluding  a  few  of  the  most  recent  aircraft  from  the 
regression  and  then  seeing  how  well  (in  terms  of  the  relative  deviation) 
the  resultant  equation  estimates  the  excluded  aircraft.  However,  in 
this  case,  the  small  sample  size  precluded  this  option.  Consequently, 
the  measure  of  predictive  capability  used  in  this  analysis  was  the 
average  of  the  absolute  relative  deviations  for  the  F-4,  F-111,  F-14, 
and  F-15.  These  relative  deviations  were  determined  on  the  basis  of  the 
predictive  form  of  the  equation  and  not  the  logarithmic  form  used  in  the 
regression. ^ ' 


It  = 

-I  , 


Fig,  2— Number  of  first  flight  events  as  a  function 
of  the  year  of  first  flight 

*'lf  cost  is  estimated  in  a  log-linear  form,  such  as 

Hn  COST  =  &o  WEIGHT  +  SPEED  +  In  e 


the  expected  cost  is  given  by 


(  ^1  ^2^  5  /  i 

COST  =  e  WEIGHT  SPEED  «e 


where  6^  is  the  actual  variance  of  t  in  the  log-linear  equation.  Since 
the  actual  variance  is  not  known,  the  standard  error  of  the  estimate  may 
be  used  as  an  approximation. 


III.  INITIAL  OBSERVATIONS 


This  section  provides  an  initial  overview  of  the  Individual  cost 
element  analyses  that  follow. 

MAGNITUDE  OF^  SIZE  VARIABLE  EXPONENTS 

The  development  of  airframe  cost-estimating  relationships  requires 
variable  exponents  that  provide  credible  results  and  conform  whenever 
possible  to  the  normal  estimating  procedures  employed  by  the  airframe 
industry.  Traditionally,  airframe  weight  has  always  provided  returns  to 
scale  (that  is,  increases  in  airframe  size  are  accompanied  by  less  than 
proportionate  Increases  in  cost).'  If  the  opposite  phenomenon  is 
observed,  then  it  is  generally  believed  to  be  the  result  of  not 
adequately  controlling  for  differences  in  construction,  materials, 
complexity,  and/or  other  miscellaneous  production  factors. 

Unfortunately,  many  of  the  regression  equations  documented  in  this 
report  possess  weight  variables  with  exponents  greater  than  1. 

In  each  case  where  a  weight  exponent  greater  than  1  was 
encountered,  attempts  were  made  to  find  variable  combinations  that  would 
reduce  it  to  less  than  1.  In  some  Instances  success  was  obtained  while 
in  others  ir  was  not,  In  any  case,  when  selecting  the  representative 
equation  sets,  no  estimating  relationship  having  a  size  variable, 
exponent  greater  than  1  was  considered  for  any  of  the  production- 
oriented  cost  elements.^ 

As  a  point  of  contrast,  it  should  be  noted  that  estimating 
relationships  based  on  total  aircraft  samples  do  not  r\ui  into  this 
problem.  As  shown  in  Fig.  3,  the  large  aircraft  (bombers  and 
transports)  force  the  regression  line  to  have  a  downward  slope  (on  a  per 

'This  concept  dates  back  to  the  early  1940s  and  the  so-called  ARCO 
factor  (which  took  its  name  from  the  WWII  Aircraft  Resources  Control 
Office) . 

'Tooling;  manufacturing  labor,  manufacturing  material,  and  total 
program  cost. 


cost 


8  9  10  11  12 

13 

Natural  logarithm  of  airframe  unit  weight 

-• 

•Equivalent  to  PROG,,,  =  2.67  AUW’  “ 

"Equivalent  to  PROG,,,  =  997  AUW®  '" 

• 

Fig.  3— Total  program  cost  per  pound  as  a 

: 

function  of  airframe  unit  weight 

• 

• 
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pound  basis)  without  having  to  consider  additional  explanatory 
variables . 

DATA  CLUSTERS 

The  difficulty  in  obtaining  credible  CERs  for  the  full  fighter 
sample  resulted  in  a  reexamination  of  the  data.  A  more  thorough 
examination  of  the  cost-weight  plot  for  each  cost  element  indicated  that 
the  fighter  data  tended  to  cluster  by  time  period  (see  Fig.  4): 

Pre-1954  (F-86,  F-89,  F-lOO,  F3D) ;  lower  left  section  of  plot 

1955-1960  (F3H,  F4D,  F-101,  F-102,  F-104,  F-105,  F-106):  middle 
upper  section  of  plot 

Post-1960  (F-4,  F-111,  F-14,  F-15):  upper  right  section  of  plot 

This  observation  is  most  pronounced  for  the  engineering,  tooling, 
material,  flight  test,  and  total  program  cost  elements. 

Unfortunately,  we  were  not  able  to  adequately  address  the 
underlying  causes  of  these  clusters.  However,  given  our  observation 
regarding  the  clustering  and  the  fact  that  the  objective  of  a  CER  is 
prediction  (as  opposed  to  database  explanation),  then  the  po5t-1960 
fighters  would  certainly  seem  to  be  a  reasonable  guide.  Consequently, 
additional  analysis  limited  to  the  post-1960  aircraft  was  undertaken. 
Since  there  ware  only  four  observations  in  the  post- 1960  sample,  the 
equations  were  determined  by  visual  fitting  rather  than  by  statistical 
analysis.  The  fitting  for  each  cost  element  was  done  on  the  basis  of  a 
single  variable- -airframe  unit  weight  (except  for  flight  test  where  the 
number  of  test  aircraft  was  utilized). 

A  comparison  of  a  few  of  the  key  variables  for  the  full  fighter 
sample  and  the  post-1960  sample  Js  provided  in  Table  5.  As  indicated, 
the  post- 1960  group  tends  to  be  heavier  and  higher  performing  than  does 
the  group  that  contains  both  the  pre-1960  and  the  post- 1960  fighters. 

Of  particular  interest  is  the  extremely  small  amount  of  speed  variation 
in  the  post-1960  sample. 


COMPARISON  OF  FULL  AND  POST-1960  FIGHTER  SAMPLE  VARIABLE  VALUES 
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CONSTRUCTION  VARIABLES 

The  two  variables  that  characterize  what  goes  inside  an  airframe 
(the  ratio  of  avionics  weight  to  airframe  unit  weight  and  the  ratio  of 
the  quantity  empty  weight  minus  airframe  unit  weight  to  airframe  unit 
weight)  show  up  in , estimating  relationships  quite  frequently. 
Consequently,  Figs,  5  and-  6  are  presented  in  order  to  illustrate  the 
manner  in  which  these  measures  vary  with  airframe  size.  As  shown  in 
these  figures,  there  appears  to  be  little  relationship  between  these 
measures  and  airframe  unit  weight. 

TECHNOLOGY  INDEX 

We  were  able  to  identify  only  one  instance  (for  the  engineering 
cost  element)  in  which  the  objective  technology  index  was  significant  at 
the  5  percent  level  in  the  context  of  the  tested  variable  combination 
(slze/performance/technology  index) : 

2 

R  SEE  F  N 

1.13  .367  .697  . 

ENGR  =  .00243  AUW  SPPWR  PFFD  .97  .16  134  15 

100  (.000)  (.021)  (.016) 


However,  the  correlation  of  AUW  and  SPPWR  with  the  technology  index  is 
greater  than  0.9.  Furthermore,  the  equation  offers  little  advantage  (in 
terms  of  the  standard  error  of  estimate)  over  alternative  forms  without 
the  technology  index.  We  conclude  that  the  objective  technology  index, 
as  now  defined,  is  of  little  benefit  to  fighter  airframe  CERs .  The 
reason  it  did  so  poorly  in  our  analysis  is  that  it  is  really  a  composite 
performance  variable  and  consequently  very  highly  correlated  with  most 
of  the  performance  variables  we  tested  here,  Tt  should  be  noted  that 
when  the  measure  is  treated  as  a  performance  variable  rather  than  as  a 
technology  index,  it  does  about  as  well  as  speed  and  specific  power  as 
an  explanatory  variable. 


Ratio  of  avionics  weight  to  airframe  unit  weight  (AVAUW) 
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Fig.  6— Ratio  of  avionics  weight  to  airframe  unit  weight  (AVAUW) 
as  a  function  of  nirframc  unit  weight 
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SET  SIZE/PERFORMANCE  COMBINATIONS 

On  the  basis  of  a  summary  examination  of  all  two-variable 
estimating  relationships  (size/performance)  for  all  cost  elements,  it 
was  decided  to  develop  four  distinct  equation  sets  that  maintain  the 
integrity  of  the  set  size/performance  parameters: 

•  Airframe  unit  weight  and  speed 

•  Airframe  unit  weight  and  specific  power 

•  Airframe  unit  weight  and  climb  rate 

•  Airframe  unit  weight  and  composite  performance  variable 

Generally  speaking,  the  equations  containing  the  size  variable  wetted 
area  had  higher  standard  errors  of  estimate  and  more  serious  exponent 
magnitude  problems  than  those  equations  containing  airframe  unit  weight. 
Furthermore,  the  equations  containing  empty  weight  also  had  more  serious 
exponent  magnitude  problems  than  those  equations  containing  airframe 
unit  weight.’ 

With  respect  to  the  performance  parameters,  equations  incorporating 
speed,  specific  power,  climb  rate,  maximum  specific  energy,  and  the 
composite  performance  variable  produced  significantly  better  statistical 
results  than  equations  incorporating  other  performance  variables,  Of 
the  five  variables,  however,  speed,  specific  power,  and  climb  rate  did 
slightly  better  than  the  other  two.  Therefore,  these  three  variables 
plus  the  composite  performance  variable  (because  of  its  unique 
construction)  are  carried  through  in  the  determination  of  representative 
equation  sets. 


’This  is  due  in  large  measure  to  two  facts;  (a)  the  F-i4  and  F-111 
ai'p.  40  and  70  percent  heavier,  respectively,  than  the  next  largest 
fighter  In  the  database  aiid  thus  have  a  fair  amount  of  leverage  in  the 
statistical  analysis;  and  (b)  the  F-14  and  F-111  have  higher  raclos  of 
airframe  unit  weight  to  empty  weight,  and  consequently,  when  chcnitlng 
from  AUW  to  EW,  will  not  increase  in  the  same  proportion  as  the  rest  of 
the  databas.',  Thu,'),  visualizing  a  cost -weight  plot,  changing  from 
airframe  unit  weight  to  empty  weight  will  have  the  effect  of  rotating 
the  regression  line  counterclockwise. 


IV.  ENGINEERING 


Engineering  hours  per  pound  are  plotted  as  a  function  of  airframe 
unit  weight  in  Fig.  7.  Estimating  relationships  in  which  all  equation 
variables  are  significant  at  the  5  percent  level  are  provided  in  Table 
6. 


GENERAL  OBSERVATIONS 

1.  With  the  exception  of  equations  incorporating  wetted  area 
(E23-E31),  the  estimating  relationships  show  a  tendency  to  underestimate 
the  engineering  hours  of  the  most  recent  sample  fighters. 

2.  The  exponents  of  the  size  variables,  with  one  exception  (E28) , 
are  always  greater  than  1  and  frequently  greater  than  1,5. 

3.  With  respect  to  the  construction/program  variables: 

(a)  As  adjuncts  to  various  combinations  of  size  and  ,jarformance 
variables,  several  construction/program  variables  were 
determined  to  bo  significant  at  the  5  percent  level. 
However,  their  incorporation  results  in  relatively  modest 
improvement  in  the  standard  error  of  estimate. 

(b)  The  variable  EW'AUW  (ratio  of  empty  weight  minus  airframe 
unit  weight  to  airframe  unit  weight)  possesses  a  counter¬ 
intuitive.  sign  (E37  and  EA2.)  . 

(c)  The  magi\itude  of  the  new  engine  designator  (ENGDV)  shows  a 
fair  amount  of  variability  depending  on  the 

s  Ize/per forinanco  variable  combination  (from  ,294  in  E32  up 
to  .569  in  E4Q) ,  Furthermore,  the  magnitude  of  the  ENGDV 
exponent  In  equatlon.s  E34,  E36,  E38,  and  E40  may  be 
somewhat  high.  For  example,  based  on  equation  E36 ,  a 
fighter  incorporating  a  new  engine  will  incur  30  percent 
more,  engineering  hours  than  a  fighter  incorporating  an  off- 
the-shelf  eiigino. 

(d)  The  magnitude  of  the  weapon  sy:item  de.signat.or  (WSDV)  also 
shows  a  fair  amount  of  variability  depending  on  the  size 
performance  variable  combination  (from  .458  in  E39  up  to 
.636  in  E41). 
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4.  The  equation  containing  the  fighter  technology  index  (E43)  has 
an  extremely  high  degree  of  intercor relation  (>  .9). 

REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Only  one  estimating  relationship  containing  airframe  unit  weight 
and  speed  is  listed  in  Table  6  and  that  is  £4: 


1.07  1.30 

E4  ENGR  =  .0000308  AUW  SP 

100  (.000)  (.000) 


2 

R  SEE  F  N  RP 


.93  .24  85  IS  None 


Airframe  Unit  Weight  and  Specific  Power 

Candidate  estimating  relationships  are  E6,  E32,  and  E43.  Equation 
E43  is  ruled  out  because  of  the  high  degree  of  intercorrelation.  Of  the 
two  remaining  equations,  E6  is  selected  because  of  questions  regarding 
the  stability  of  the  new  engine  designator  in  equation  E32: 

2 

R  SEE  F  N  RP 

1,24  .713  . 

E6  ENGR  =  .0290  AUW  SPPWR  .96  .19  140  15  Cur:  Under 

100  (.000)  (.000) 

Airframe  Unit  Weight  and  Climb  Rate 

Candidate  estimating  relationships  are  E7,  E33,  E34,  and  E35 . 
Equation.*}  E34  and  E35  are  ruled  out  because  of  previously  discussed 
reservation.s  concerning  the  stability  of  the  new  engine  and  weapon 
system  designator  exponents.  Equation  E33  incorporates  the  wing  type 
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designator.  The  difficulty  in  using  this  variable  in  a  predictive  mode 
is  what  numerical  value  to  assign  to  new  or  to  as  yet  undeslgnatod  wing 
concepts  (e.g.,  forward-swept,  variable  incidence).  Thus,  equation  E 7 
is  the  preferred  AW/CLIMB  estimating  relationship! 

2 

R  SEE  F  N  RP 

1.46  .483  . 

E7  ENGR  «  .0000396  AIJW  CLIMB  .90  .29  55  15  Cur:  Under 

100  (.000)  (.000) 

Airframe  Unit  Weight  and  Composite  Performance  Index 

Only  one  estimating  relationship  containing  airframe  unit  weight 
and  the  composite  performance  index  is  listed  in  Table  6  and  that  is  £9: 


2 

R  SEE  F  N  RP 

1.08  1.28  . 

E9  ENGR  =  .000198  AUW  PFFD  .96  .18  146  15  None 

100  (.000)  (.000) 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  43  engineering  manhour 
equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  E4,  E8,  E9,  E73,  and  E78.  All  have  relatively  low  standard 
errors  of  estimate  and  all  are  free  of  unusual  residual  patterns. 
Equation  £9  is  arbitrarily  selected: 


2 

R  SEE  F  N  RP 

1.08  1.28  . 

E9  ENGR  =  .000198  AUW  PFFD  ,96  .18  146  15  None 

100  (.000)  (.000; 
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Post- 1960  Sample 

.887 

ENGR  =  2.31  AUW 
100 


neering 


ENGINEERING  HOUR  ESTIMATING  RELATIONSHIPS 
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1.13  . 567  . 458 

E39  ENGR  =  .0497  EW  SPPWR  WSOV  .95  .23  64  15  -14  +21  +9  +4  12  HCOL:  r(WSDV)  > 

TOO  (.000)  (.000)  (.050)  RP:CUR:UNDER 

I0;F-101,F-104 

F-111 
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V.  TOOLING 


Tooling  hours  per  pound  are  plotted  as  a  function  of  airframe  unit 
weight  in  Fig.  8.  Estimating  relationships  in  which  all  equation 
variables  are  significant*  at  the  5  percent  level  are  provided  in  Table 
7. 

GENERAL  OBSERVATIONS 

1.  Only  one  equation  possesses  a  standard  error  of  estimate  of 
less  than  30  percent  and  tliat  one  (T27)  contains  a  variable  with  a 
counterintuitive  sign. 

2.  The  magnitude  of  the  wetted  area  exponent  (T16-T20)  i.s  in  every 
case  greater  than  or  equal  to  one. 

3.  With  respect  to  the  construction/program  variables! 


(a)  The  sign  of  the  wing  area  to  wetted  area  variable  (WGWET) 
is  counterintuitive  (T21  through  T25,  and  T27). 

(b)  The  magnitudes  of  the  contractor  experience  designator 
(EXPDV  in  T26),  the  weapon  system  designator  (WSDV  in  T30) , 
and  the  prototype  program  designator  (PRGDV  in  T31)  all 
seem  fairly  largo.  For  example,  a  contractor  without 
experience  would  incur  tooling  costs  56  percent  greater 
than  a  contractor  with  experience;  a  weapon  system  would 
incur  tooling  costs  75  pesrcent  greater  than  a  gun  platform; 
and  a  prototype  program  would  incur  tooling  costs  40 
percent  loss  than  a  concurrent  program. 

(c)  The  equations  containing  the  wing  typo  designator  (T28  and 
T29)  present  an  unusual  problem.  A  quick  Inspection  (see 
Fig.  9)  indicates  that  both  variable  sweep  aircraft  are 
ovisrestimated  while  all  three  delta-wing  aircraft  are 
underestimated.  This  suggests  that  perhaps  the  rank¬ 
ordering  of  the  two  wing  typos  should  be  reversed, 

However,  at  this  time,  no  logical  basis  exists  for  making 
such  a  reversal. 

(d)  The  variable  "maximum  tooling  capability"  was  not  found  to 
be  significant  at  the  5  percent  level  in  any  equation  form. 
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4.  The  fighter  technology  index  was  not  found  to  be  significant  at 
the  5  percent  level  in  the  required  equation  form  (size/performance/ 
technology  index) . 

REPRESE.NTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  T4  and  T21.  Equation  T21  is 
eliminated  because  it  contains  a  variable  (WGWET)  with  a 
counterintuitive  sign. 


.627  .740 

T4  TOOL  =  .0981  AUW  SP 

100  (.026)  (.027) 


2 

R  SEE  F  N  RP 


.64  .39  11  15  None 


Airframe  Unit  Weight  and  Specific  Power 

Candidate  estimating  relationships  are  T6  and  T22.  Equation  T22  is 
eliminated  because  it  contains  a  variable  (WGWET)  with  a 
counterintuitive  sign. 


T6  TOOL 

100 


.700  .444 

5.93  AUW  SPPWR 
(.007)  (.010) 


2 

R  SEE  F  N  RP 


.69  ,36  13  IS  None 


I 

1 

I 


« 
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Airframe  Unit  Weight  and  Climb  Rate 

Candidate  estimating  relationships  are  T7  and  T23.  Equation  T23  is 
eliminated  because  it  contains  a  variable  (WGWET)  with  a 
counterintuitive  sign. 

2 

R  SEE  F  N  RP 

.846  .278  . 

T7  TOOL  =  .110  AUV  CLIMB  .62  .40  10  15  None 

100  (.003)  (.038) 


Airframe  Unit  Weight  and  Composite  Performance  Index 

Only  one  estimating  relationship  containing  airframe  unit  weight 
and  the  composite  performance  index  is  listed  in  Table  7:  TS; 


,657  ,684 

T8  TOOL  =  ,295  AUW  PFFD 
100  (,020)  (.027) 


2 

R  SEE  F  N  RP 


.64  ,39  11  IS  None 


Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  31  tooling  manhour  equations, 
the  list  of  candidate  estimating  relationship  has  been  narrowed  to  T6 , 
T9,  T12,  and  T15,  Equation  T12  is  selected  on  the  basis  of  the  lowest 
standard  error  of  estimate; 


T12  TOOL 


.865  .382 

=  .876  EW  SPPWR 
(.003)(.017) 


2 

R  SEE  F  N  RP 


.73  .33  17  15  None 


100 


Natural  logarithm 
of  airframe  unit 
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O  F-102 


A  Gun  platform 
O  Weapon  system 


A  F-4D 


F-104A 


,  Visual  determination  for  post-1960  aircraft 
(equivalent  to  TOOL-ioo  =  1-38 


Based  on  Eq.  T1 


A  F-101  \ 

A  F3H  ^ 

Po8t-1960  fighters' 


O  F-105 


A  F-100 


Pre'1954  fighters 


Natural  logarithm  of  airframe  unit  weight 


Fig.  8— Itaoling  hours  per  pound  as  a  function  of  airlVamo  unit  weight 


Natural  logarithm  of  tooling  hours  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 


Fig.  9— Tboling  hours  per  pound  as  a  function  of 
airframe  unit  weight  and  wing  type 


TOOLING  HOUR  EST I  HATING  RELATIONSHIPS 
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VI.  MANUFACTURING  LABOR 


Manufacturing  labor  hours  per  pound  are  plotted  as  a  function  of 
airfr^ime  unit  weight  in  Fig.  10.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided 
i n  Table  8 . 

GENERAL  OBSERVATIONS 

1.  In  all  but  three  equations  (LB,  LIO,  and  Lll) ,  the  magnitude  of 
the  size  variable  exponent  is  greater  than  or  equal  to  1, 

2.  Only  two  equations  were  identified  in  which  performance 
variables  were  significant  and  in  both  cases  the  magnitude  of  the  size 
variable  was  greater  than  or  equal  to  1. 

3.  The  standard  errors  of  estimate  were  clustered  between  .27  and 

.35. 

4.  With  respect  to  the  construction/program  variables: 


(a)  No  estimating  relationships  were  identified  in  which 
construction/program  variables  appeared  in  conjunction  with 
a  sizc/performance  variable  combination. 

(b)  The  weapon  system  designator  (WSDV)  in  Equations  in  L8 , 

LIO,  and  Lll  indicates  that  a  fighter  with  missile  armament 
and  a  sophisticated  fire  control  system  will  incur  40  to  45 
percent  higher  labor  costs  than  will  a  fighter  that  is 
simply  a  gun  platform, 

(c)  The  avionics  to  airframe  unit  weight  variable  in  Equations 
L7  and  L9  indicates  that  a  50  percent  increase  in  the  ratio 
will  result  in  roughly  10  percent  increase  in  labor  costs. 

(d)  The  variable  EWAUW  (ratio  of  empty  weight  minus  airframe 
unit  weight  to  airframe  unit  weight)  in  Equations  L6  and 
Lll  indicates  that  a  50  percent  Increase  in  the  ratio  will 
result  in  a  20  to  25  percent  increase  in  labor  costs. 
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(e)  The  variable  "maximum  tooling  capability"  was  not  found  to 
be  significant  at  the  S  percent  level  on  any  equation  form. 

5.  The  fighter  technology  index  was  not  found  to  be  significant  at 
the  5  percent  level  in  the  required  equation  form  (size/performance/ 
technology  index). 

REPRESENTATIVE  CERS 
Airframa  Unit  Weight  and  Speed 

No  estimating  relationships  containing  this  size/performance 
variable  combination  were  identified. 

Airframe  Unit  Weight  and  Specific  Power 

No  estimating  relationshlpii'.  containing  this  size/performance 
variable  combination  were  identified. 

Airframe  Unit  Weight  and  Climb  Rate 

No  estimating  relationships  containing  this  size/performance 
variable  combination  were  identified. 

Airframe  Unit  Weight  and  Composite  Performance  Index 

No  estimating  relationships  containing  this  size/performance 
variable  combination  were  identified. 

Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  11  manufacturing  labor 
manhour  equations,  the  list  of  candidate  estimating  relationships  has 
been  narrowed  to  L8,  LIO,  and  Lll,  Equation  L8  is  selected  because  it 
most  closely  corresponds  to  our  expectations  concerning  the  magnitude  of 
the  size  variable: 

2 

R  SEE  F  N  RP 

.774  .558  . 

L8  LABR  =  6.55  AUW  WSDV  .75  .31  18  15  None 

100  (.005)  (.049) 
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Post- 1960  Sample 

The  following  equation  was  visually  fit  to  the  data  with  the  F-4 
observation  essentially  ignored.  Inclusion  of  the  F-4  would  have 
resulted  in  an  equation  with  an  exponent  far  too  small  to  be  credible 
(for  each  doubling  of  weight,  total  labor  hours  would  have  increased  by 
only  about  20  percent). 

.678 

LABR  =  23.0  AUW 
100 


I 

! 


( 


Natural  logarithm  of  manufacturing  labor  hours  per  pound 
of  airframe  unit  weight  (CA  at  Q  =  100) 
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Fig.  10— Manufacturing  labor  hours  per  pound  as  a  function 
of  airframe  unit  weight 


MANUFACTURING  LABOR  HOUR  ESTIMATING  RELALTIONSHI PS 


Statistics  Relative  Deviations  (I) 
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VII.  MANUFACTURING  MATERIAL 


Manufacturing  material  cost  per  pound  is  plotted  as  a  function  of 
airframe  unit  weight  in  Fig.  11.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided 
in  Table  9 . 

GENERAL  OBSERVATIONS 

1.  The  magnitude  of  the  size  variable  exponent  is  greater  than  1 
in  all  but  one  equation  (N41).  No  combination  of  variables  could  be 
found  that  would  bring  it  below  1  (although  the  weapon  system  designator 
did  bring  it  down  to  1). 

2.  Estimating  relationships  without  a  performance  variable  (Ml, 

M2,  M3,  M41,  M42 ,  M43)  show  a  tendency  to  underestimate  the  material 
coRt.s  of  the  most  recent  fighters, 

3.  With  respect  to  construction/program  variables: 


(a) Two  construction  variables  show  up  repeated ly-“AVAUW 
(ratio  of  avionics  weight  to  airframe  unit  weight)  and 
EWAUW  (ratio  of  empty  weight  minus  airframe  unit  to 
airframe  unit  weight).  Unfortunately,  they  genera  i,Iy 
tend  to  exacerbate  the  size  variable  exponent  magriitude 
problem.  Furthorinorc,  the  magnitude  of  the  variable 
IIWAUW  shows  a  fair  amount  of  variabllity-frotn  .305  in 
M34  to  ,742  in  M28.  On  the  other  hand,  the  variable 
AVAUW  show.s  relatively  little  variation  across 
alternative  equiit  ions- -from  ,177  in  M39  to  ,257  in  M27 , 

(b) ThG  magnitude  of  the  weapon  system  designator  (WSDV)  in 
Equations  N41,  M42,  and  M43  seems  siomewhat  large. 

Those  equation,s  indicate  that  a  weapon  system  will 
incur  75  to  90  percent  greater  material  costs  than  a 
gun  pintlorni.  On  the  other  hand,  a  reinspection  of 
I'ig,  11  iinggo:jts  that  if  the  full  fighter  sample  is  to 
be  utilized,  then  the  magnitude  of  the  weapon 
systom/gun  platform  difference  may  not  be  all  that 
unreasonable , 
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4.  The  fighter  technology  index  was  not  found  to  be  significant  at 
the  5  percent  level  in  the  required  equation  form  (slze/performanco/ 
technology  index). 

REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and-  Speed 

No  acceptable  estimating  relationships  containing  this 
size/perforiiiance  variable  combination  were  Identified  (i.e.,  the 
magnitude  of  all  size  variable  exponents  was  greater  than  1). 

Airframe  Unit  Weight  and  Specific  Power 

No  acceptable  estimating  relationships  containing  this 
size/performance  variable  combination  were  identified  (i.e.,  the 
magnitude  of  all  size  variable  exponents  was  greater  than  1) . 

Airframe  Unit  Weight  and  Climb  Rate 

No  acceptable  estimating  relationships  containing  this 
size/perforinance  variable  combination  were  identified  (i.e.,  the 
magnitude  of  all  size  variable  exponents  was  greater  than  1). 

Airfr?me  Unit  Weight  and  Compoaite  Performance  Index 

No  acceptable  estimating  relationships  containing  this 
slze/performanco  variable  combination  were  identified  (i.e.,  the 
magnitude  of  all  size  variable  exponents  was  greater  than  1). 

Single  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  43  manufacturing  material 
cost  equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  one--M41.  It  is  the  only  equation  with  a  size  variable 
exponent  less  than  1  (albeit  just  barely). 

2 

R  SEE  F  N  RP 

.999  .935  . 

M41  MATE  =5.68  AUW  WSDV  .82  .36  2  7  1.3  Cur:  Under 

(.003)  (.011) 


100 


Natural  logarithm  of  manufacturing  material  cost 
per  pound  of  airframe  unit  weight  (CA  at  Q  =  100 


MATERIAL  COST  ESTIMATING  RELAT 


KAGrAUW 


Statistics  Relative  Deviations  (%) 
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VIII.  DEVELOPN^PNT  SUPPORT  | 

M 

1 

i 

1 

Development  support  cost  per  pound  is  plotted  as  a  function  of  j 

airframe  unit  weight  in  Fig.  12.  Estimating  relationships  in  which  all 
equation  variables  are  significant  at  the  5  percent  level  are  provided  i — S 

in  Table  10. 

GENERAL  OBSERVATIONS 

I 

1.  None  of  the  estimating  relationships  listed  in  Table  10  comes 
close  to  meeting  the  standard  error  of  estimate  goal  of  0.18. 

2.  With  one  exception  (D8),  the  magnitude  of  the  size  variable 
exponents  is  greater  than  1.7. 

3.  No  equation  containing  a  size/performance  variable  combination  ^ 

was  identified. 

4.  As  adjuncts  to  airframe  unit  weight  and  empty  weight,  several 
construction/program  variables  were  determined  to  be  significant  at  the 

5  percent  level,  However,  they  provide  relatively  modest  improvement  in  • 

the  equation  standard  error  of  estimate.  Furthermore,  with  the 
exception  of  the  variable  AVAUW,  most  have  fairly  large  exponents. 

5.  The  fighter  technology  index  was  not  found  to  be  significant  at 

the  5  percent  level  in  the  required  equotion  form  (size/performance/  ,  • 

technology  index) . 

REPRESENTATIVE  CERS 

Obviously,  the  equations  are  missing  an  important  element  of  •! 

development  support  cost.  The  missing  clement  could  take  the  form  of  an 
explanatory  variable  such  as  the  quantity  of  mockups  and  test  articles 
or  it  could  take  the  form  of  a  complementarity  between  development 

support  and  another  cost  clement  such  as  engineering.  • 

Previous  RAND  airframe  models  used  initial  engineering  hours^  and 
airframe  unit  weight,  speed,  and  the  number  of  test  aircraft*  as 

Mief.  1,  p.  21. 

*Ref.  2,  p.  13.  • 
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explanatory  variables.  This  study  was  unable  to  establish  a  logical 
link  between  development  support  cost  and  the  number  of  flight  test 
aircraft.  Nonrecurring  engineering  cost  seemed  logical,  however,  since 
the  mockups  and  test  articles  that  make  up  development  support  are 
required  for  the  airframe  design  effort.  Thus,  given  the  poor  results 
of  the  regression  analysis,  development  support  costs  are  estimated 
simply  as  a  percentage  of  nonrecurring  engineering  costs.  Based  on  the 
data  provided  in  Table  11,  the  following  values  were  obtained: 

Development  Support  Cost 
as  a  Percentage  of 
Unit  1  Engineering  Cost 

Full  fighter  sample  108 

Post-1960  sample  68 

Note  that  the  values  shown  in  Table  11  range  from  a  low  of  14  percent 
(the  F-104)  to  a  high  of  323  percent  (the  F-101). 


Natural  logarithm  of  development  support  cost  per  pound 
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O  F-102 


PosM960  fighters 


vO  F-15 


A  F-101 


O  F-106 


A  Gun  platform 
O  Weapon  system 


OF-14 


O  F-105 


F4D  A 


<  A  F3H  / 

^  Based  on  ip 

Eq.  D1  V - 


A  F-104 


F-100  A 
A  F3D 


Pre-1954  fighters 


AF-89 


Natural  logarithm  of  airframe  unit  weight 


Fig.  12— Development  support  cost  per  pound  as  a  function 
of  airframe  unit  weight 


DEVELOPMENT  SUPPORT  COST  ESTIMATING  RELATIONSHIPS 
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Table  10  (continued) 
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Table  11 

DEVELOPMENT  SUPPORT  COST  AS  A  PERCENTAGE  OF 
UNIT  1  ENGINEERING  COST 


Fighter 

Unit  1 
Engineering 
Hour's 

Unit  1 
Engineering 
Cost  ($M)(a) 

Development 
Support 
Cost  ($M) 

Development  Support 
as  a  %  of  Unit  1 
Engineering  Cost 

F3D 

400,000 

11.0 

10.3 

94 

F3H 

1,300,000 

35.8 

36.3 

102 

F4D 

1,600,000 

44.0 

25.3 

58 

F-S6 

690,000 

19.0 

9.0 

48 

F-89 

9.50,000 

26.0 

16.6 

63 

F.4 

5,000,000 

137.0 

42.8 

31 

F-lOO 

1,450,000 

39 . 9 

13.8 

34 

F-101 

1,200,000 

33.0 

106.7 

323 

F*102 

2,000,000 

55.0 

157.0 

286 

F-104 

1,670,000 

45.9 

6.5 

14 

F-105 

4,800,000 

132.0 

74.4 

56 

F-106 

1, 400 j 000 

38.5 

103.1 

268 

F-lll 

12,500,000 

343.8 

360.3 

105 

F-14 

8,000,000 

233.8 

138.3 

59 

F-IS 

7,. 500, 000 

206.2 

161.0 

78 

(a)Ar.  $27. .50  per  hour. 
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IX.  FLIGHT  TEST 


Flight  test  cost  per  aircraft  Is  plotted  as  a  function  of  the 
quantity  of  flight  test  aircraft  in  Fig.  13.  Estimating  relationships 
in  which  all  equation  variables  are  significant  at  the  5  percent  level 
are  provided  in  Table  12. 

GENERAL  OBSERVATIONS 

1.  In  general,  the  flight  test  estimating  relationships  have 
relatively  high  standard  errors  of  estimate  compared  to  the  goal  of 
0.18. 

2.  The  magnitude  of  the  test  aircraft  exponent  is  never  less  than 
1.  Normally,  one  would  expect  that  as  the  number  of  test  aircraft 
increases,  less  testing  would  be  required  of  each  aircraft. 
Unfortunately,  this  analysis  was  not  able  to  verify  this  premise. 

3.  Equations  incorporating  specific  power  and  the  composite 
performance  inde,x  (F5,  F8,  FIO,  I'T3,  F16,  and  F19)  do  very  poorly  on  the 
F-15  aircraft. 

REPRESENTATIVE  CERS 

Airframe  Unit  Weight,  Speed,  and  Test  Aircraft 


.771  1.62  1.30 

F4  FT  =  .0000215  AUW  SF  TESTAC 
(.061)  (.007)(.003) 


R  SEE  F  N  RP 


.80  .59  15  15  None 


Airframe  Unit  Weight,  Specific  Power,  and  Test  Aircraft 


.940  .951  1.25 

F5  FT  =  .179  AUW  SPPWR  TESTAC 

(.013)  (.002)  (.002) 


R  SEE  1'  N  RP 


.85  .52  20  15  None 


I 
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Airframe  Unit  Weight,  Ciimb  Rate,  and  Test  Aircraft 


1.27  .601  1.44 

F6  FT  =  .0000177  AUW  CLIMB  TESTAC 

(.004)  (.011)  (.002) 


2 

R  SEE  F  N  RP 


.79  .61  14  15  None 


Airframe  Unit  Weight,  Composite  Performance  index,  and  Test  Aircraft 


.807  1.'’'4  1.21 

F8  FT  =  .000313  AUW  PFFD  TESTAC 
(.051)  (.007)  (.006) 


2 

R  SEE  F  N  RP 


.80  .59  15  15  None 


Singie  Best  Estimating  Relationship 

Based  on  a  summary  examination  of  all  21  flight  test  cost 
equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  F5,  F9,  FlO,  Fll,  and  F12.  Equation  F-10  has  the  lowest 
standard  error  of  estimate  while  F12  places  the  least  emphasis  on  the 
test  aircraft  variable.  Equation  FlO  is  selected: 


1.24  .846  1.25 

FlO  FT  =  .00623  EW  SPPWR  TESTAC 

(.002)(.002)  (.001) 


2 

R  SEE  F  N  RP 


.88  .45  28  15  None 


Post-1960  Sample 


.687 


FT  =  27100  TESTAC 


Fig.  lij  -Flight  test  cost  per  test  aircraft  as  a  function  of 
the  quantity  of  flight  test  aircraft 


FLIGHT  TEST  COST  ESTIMATING  RELATIONSHIPS 
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X.  QUALITY  CONTROL 


Quality  control  hours  per  pound  are  plotted  as  a  function  of 
airframe  unit  weight  in  Fig.  14.  The  data,  which  do  not  fit  any  obvious 
patterns,  are  available  for  only  eight  aircraft.  Consequently, 
regression  analysis  does  not  seem  appropriate.'  However,  fiince  quality 
control  is  closely  related  to  direct  manufacturing  labor,  it  can  be 
estimated  as  a  percentage  of  same.  The  ratio  of  cumulative  quality 
control  hours  to  cumulative  manufacturing  labor  hours  is  as  follows: 


Aircraft  Ratio  (at  Q  =  100) 


F-4 

F-lOO 

F-102 

F-IOS 

F-106 

F-111 

F-14 

F-IS 


.076 

.123 

.069 

.101 

.172 

.162 

.116 

.181 


Average,  all  fighters  .125 

Average,  post-1960  fighters  .134 


'  One-variable  estimating  relationships  containing  the  three  size 
characteristics  were  determined,  though,  and  are  presented  in  Table  13, 


Natural  logarithnt  of  quality  control  hours  per  pound  of 


Fig,  14— Quality  control  hours  per  pound  as  a  function  of  airframe  unit  weight 
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XI.  TOTAL  PROGRAM  COST 


Total  program  cost  per  pound  is  plotted  as  a  function  of  airframe 
unit  weight  in  Fig.  15.  Estimating  relationships  in  which  all  equation 
variables  are  significant  at  the  5  percent  level  are  provided  in  Table 
14. 


GENERAL  OBSERVATIONS 

1.  Many  cost  analysts  believe  greater  accuracy  can  be  obtained  by 
estimating  at  the  total  program  level  rather  than  the  individual  cost 
element  level,  and  that  this  approach  eliminates  definitional  problems 
and  minimizes  the  effects  of  cost  element  complementarities.  It  does 
have  one  serious  drawback,  however:  It  is  based  on  labor  rates  for  a 
given  year.  Calculation  of  a  composite  adjustment  factor  to  update  the 
base  year  costs  requires  that  escalation  rates  be  determined  for  each 
cost  element  and  then  weighted  by  the  appropriate  cost  element 
proportion  of  total  cost.  Since  there  is  evidence  to  suggest  that  the 
individual  cost  elements  increase  at  different  annual  rates ^  and  since 
the  proportion  of  total  co.st  held  by  each  cost  element  varies  with 
quantity,*  the  task  is  not  a  trivial  one. 

2.  Of  the  65  equations,  approximately  80  percent  have  size 
variables  with  exponents  greater  than  1. 

3.  With  respect  to  the  construction/program  variables: 

(a)  The  ratio  of  wing  area  to  wetted  area  has  a  counter¬ 
intuitive  sign  each  time  it  appears. 

(b)  The  variable  PRGDV  suggests  that  a  prototype  development 
approach  would  incur  only  60  to  70  percent  of  the  costs  of 
a  concurrent  development  approach. 


^Sec  Sec.  XIV. 
*  See  Sec ,  II, 
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(c)  The  two  variables  that  characterize  what  gets  stuffed  into 
an  aircraft,  AVAUW  and  EWAUW,  appear  fairly  frequently. 

The  minimum  (.214  in  P59)  and  maximum  (.319  in  P38)  AVAUW 
exponent  values  indicate  that  a  50  percent  increase  in  the 
ratio  of  avionics  weight  to  airframe  unit  weight  will 
result  in  a  9  to  14  percent  increase  in  total  program 
costs.  The  minimum  (.494  in  P31)  and  maximum  (.656  in  P27) 
EWAUW  exponents  indicate  that  a  50  percent  increase  in  the 
ratio  of  empty  weight  minus  airframe  unit  weight  to 
airframe  unit  weight  will  result  in  a  20  to  30  percent 
increase  in  total  program  cost.  From  the  standpoint  of 
credibility,  the  magnitude  of  the  change  in  total  program 
cost  resulting  from  the  AVAUW  increase  seems  quite 
reasonable  but  the  change  resulting  from  the  EWAUW  increase 
seems  somewhat  excessive, 

(d)  The  magnitude  of  the  weapon  system  designator  (WSDV)  shows 
a  fair  amount  of  variability  depending  on  the  other 
equation  variables.  When  used  in  conjunction  with  a 
size/performance  variable  combination,  the  exponent  varies 
between  .550  (P62)  and  .658  (P58)"-a  weapon  system  would 
cost  45  to  60  percent  more  than  a  gun  platform.  When  used 
in  conjunction  with  only  a  size  variable,  the  exponent 
varies  between  .834  (P6S)  and  .944  (P64)--a  weapon  system 
would  cost  80  to  90  percent  more  than  a  gun  platform. 

These  latter  values  seem  fairly  large  until  one  looks  at 
the  plot  (Fig.  15) . 

(e)  The  wing  type  designator  (WGTYPE)  appears  in  equations 
several  times,  The  exponent  magnitude  suggests  that  a 
fighter  with  a  variable  sweep  wing  will  incur  25  (P50)  to 
45  percent  (P40)  higher  program  costs  than  a  swept  wing 
fighter.  This  seems  somewhat  excessive.  Additionally,  an 
equation  using  this  variable  could  pose  potential  problems 
if  used  for  an  advanced  design  fighter  incorporating  a  new 
or  as  yet  undos ignated  wing  concept  such  as  forward  sweep 
or  variable  incidence:  What  numerical  value  should  be 
assigned  to  the  new  concept? 

4.  The  fighter  technology  index  was  not  found  to  be  significant  at 
the  5  percent  level  in  the  required  equation  form  (size/performance/ 
technology  index) . 
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REPRESENTATIVE  CERS 
Airframe  Unit  Weight  and  Speed 

Candidate  estimating  relationships  are  P4,  P27,  P28,  P29,  and  P30. 
Equations  P27,  P28,  and  P29  are  eliminated  for  reasons  of  size  variable 
exponent  magnitude.  Of  the  two  remaining  estimating  relationships,  P30 
is  eliminated  because  it  ’contains  the  wing  type  designator,  which  could 
prove  troublesome  for  advanced  wing  concepts.  This  leaves  P4: 

2 

R  SEE  F  N  RP 
.951  .800  . 

P4  PROG  =  .450  AUW  SP  .82  .31  28  15  None 

100  (.001)  (.007) 

Airframe  Unit  Weight  and  Specific  Power 

Candidate  estimating  relationships  are  P6,  P31,  P32,  P33,  P34,  P35 , 
and  P36.  Equations  P6,  P31,  P32,  and  P33  are  eliminated  for  reasons  of 
size  variable  exponent  magnitude.  Equation  P34  is  eliminated  because  it 
contains  the  wing  type  designator,  which  could  prove  troublesome  for 
advanced  wing  concepts.  Equation  P36  is  eliminated  because  the 
magnitude  of  the  program  type  designator  (PRGDV)  seems  excessive.  This 
leaves  P3S. 


.805  .349  .557 

P35  PROG  =  290  AUW  SPPWR  WSDV 

(.001)  (.012)  (.041) 


2 

R  SEE  F  N  RP 


.90  .25  32  15  None 


100 
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Airframe  Unit  Weight  and  Ciimb  Rate 

No  acceptable  estimating  relationships  containing  this 
size/performance  variable  combination  were  identified.  The  magnitude  of 
all  size  variable  exponents  in  candidate  CERs  (P7,  P37,  P38,  P39,  and 
P40)  was  greater  than  1. 

Airframe  Unit  Weight  and  Composite  Performance  Index 

Candidate  estimating  relationships  are  P9,  P44,  P45,  P46,  and  P47. 
Equations  P44  and  P45  are  eliminated  for  reasons  of  size  variable 
exponent  magnitude.  Equation  P46  is  eliminated  because  it  contains  the 
wing  type  designator,  which  could  prove  troublesome  for  advanced  wing 
concepts.  Equation  P47  is  eliminated  because  the  magnitude  of  the 
program  type  designator  (PRGDV)  seems  excessive.  This  Ljaves  P9: 


2 

R  SEE  F  N  RP 

.951  .810  . 

P9  PROG  =  1.39  AUW  PFFD  .95  .29  33  15  None 

100  (.000)  (.003) 


Single  Best  Estimating  Relationships 

Based  on  a  summary  examination  of  all  65  total  program  cost 
equations,  the  list  of  candidate  estimating  relationships  has  been 
narrowed  to  P4,  P9,  P35,  P54,  P62,  and  P64.  Of  these,  P35,  P54,  and  P62 
have  the  lowest  standard  errors  of  estimate-“between  .20  and  .25.  Of 
these  last  three,  equation  P35  is  preferred  because  it  provides  more 
reasonable  economies  of  scale  with  respect  to  the  size  variable: 


.805  .349  .557 

=  290  AUW  SPPWR  WSDV 

100  (.000)  (.012)  (.041) 


2 

R  SEE  F  N 


RP 


P35  PROG 


.90  .25  32  15  None 


program  cost  per  pound 


^1 


Visual  determination  for  posM960  aircraft 
(equivalent  to  PROQ100  =  550  AUwO-812) 


F-102  O 


AF4D 


O  F-106 


A  F-101 


O  F-14. 


A  F-104 


O  F-105 


Po8t-1960  fighters  ■ 


AF3H 


'Based  on  Eq.  P1 


A  Gun  platform 
O  Weapon  system 


-PrB-1954  fighters 


AF-86 


A  F-100 


F-89A 


Natural  logarithm  of  airframe  unit  weight 
Fig.  16— Tbtal  program  cost  per  pound  as  a  function  of  airframe  unit  weight 


TOTAL  PROGRAM  COST  ESTIMATING  RELATIONSHIPS 


Table  14  (continued) 


Table  14  (continued) 


Table  14  (continued) 
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XII.  SELECTION  OF  RECOMMENDED  EQUATION  SET 


The  representative  equation  sets  for  the  four  size/performance 
variable  combinations  (airframe  unit  weight/speed,  airframe  unit 
weight/specific  power,  airframe  unit  weight/climb  rate,  and  airframe 
unit  weight/composite  performance  index)  as  well  as  the  equation  set 
containing  the  "best"  estimating  relationship  for  each  cost  element 
(irrespective  of  the  size/performance  variable  combination)  are  listed 
in  Tables  15  through  19.  Additionally,  the  post-1960  equation  set  is 
listed  in  Table  20.  A  comparison  of  these  equation  sets  based  on  the 
relative  deviations  of  the  four  most  recent  fighters  (F-4,  F-111,  F-14, 
and  F-15)  is  provided  in  Table  21.  Based  on  a  review  of  these  tables, 
the  following  observations  are  made: 

(1)  No  acceptable  estimating  relationships  incorporating 
size/performance  variables  could  be  determined  for  the  labor,  material, 
and  development  support  cost  elements. 

(2)  Based  on  the  standard  error  of  estimate,  little  difference 
exists  between  the  equation  sets  derived  by  statistical  methods. 
Moreover,  only  one  CER  reaches  our  standard  error  of  estimate  goal  of 
0.18  (see  Table  22). 

(3)  Based  on  relative  deviations  with  respect  to  the  F-4,  F-111, 
F-14,  and  F-15  (Table  21),  the  two  sets  that  do  the  best  are  aiiJrame 
unit  weight/speed  and  post-1960,  The  post-1960  result  is  not  too 
surprising,  however,  since  the  weight-scaling  relationships  are  based  on 
the  same  four  aircraft. 

(4)  Based  on  comparisons  of:  (a)  the  standard  errors  of  individual 
estimating  relationships;  and  (b)  relative  deviations  with  respect  to 
the  F-4,  F-111,  F-14,  and  F-15,  there  is  no  advantage  in  mixing  the  set 
size/performance  variables. 

(5)  With  the  exception  of  the  number  of  test  aircraft  (for  the 
flight  test  cost  element),  the  only  construction/program  variable  that 
was  influential  in  Improving  the  quality  of  the  CERs  was  the  weapon 
system  designator  (WSDV) . 


REPRESENTATIVE  SETt  AIRFRAME  UNIT  WEIGHT  AND  SPEED 


^Siace  no  acceptable  estimating  relationships  incorporating  airframe  unit  weight  and  speed  could  be 
determined,  these  alternative  estimating  relationships  were  inserted  to  complete  the  equation  set. 

^ENGRC^  =  $27.50  *  ENGR^qq  *  lOO"'^^^. 


REP:^SENTATIVE  set:  AIRFilAME  UNIT  WEIGHT  AND  CLIMB  RATE 


Since  no  acceptable  estimating  relationships  incorporating  airframe  unit  weight  and  climb  rate  could  be 
determined,  these  alternative  estimating  relationships  were  inserted  to  coi!5>lete  the  equation  set. 

^ENGRC^  =  $27.50  *  ENGE^q^  *  100“’^^^. 


REPRESENTATIVE  SET:  AIRFPiAME  UNIT  HEIGHT  AND  COMPOSITE  PERFORMANCE  INDEX 
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REPRESENTATIVE  SET:  SINGLE  BEST  EQUATION  FOR  EACH  COST  EL 
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Table  20 


REPRESENTATIVE  SET;  POST- 1960  SAMPLE 
(F-4,  F-111,  F-14,  and  F-15) (a) 


.887 


ENGR  «  2.31  AUW 
100 


.883 


TOOL  =  1.38  AUW 
100 


.678 


LABR  =23.0  *  AUW 
100 


.766 


MATL  =  127  AUW 
100 


DS  =  .68  *  ENGRC  (b) 

1 


.687 


FT  =  27100  TESTAC 


QC  =  .134  *  LABR 
100  100 


.812 


PROG  =  550  AUW 
100 


(a) Detertnined  by  visual  rather  than  statistical  means, 

(b) ENGRC^QQ  =  $27.50  *  ENGR^q^  *  lOO"'^^^. 


„  :J 
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RELATIVE  DIFFERENCES  BETWEEN  ACTUALS  AND  REPRESENTATIVE  EQUATION  SET  EST! 
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Table  22 

SUMMARY  OF  STANDARD  ERRORS  OF  ESTIMATE 


Cost  Element 

Percentage 
of  Total 
Cost  at 

Q  =  100 

Equation  Set 

Auwysp 

AUV/SPPWR  AUW/CLIMB 

AUW/PFFD 

Single 

Best 

Engineering 

20 

.24 

.19 

.29 

.18 

.  18 

Tooling 

15 

.39 

.36 

.40 

.39 

.33 

Labor 

32 

.31 

.31 

.31 

.31 

.31 

Material 

13 

.36 

.36 

.36 

.36 

.36 

Dev  support 

8 

-- 

-- 

-- 

-- 

-- 

Flight  test 

8 

.59 

.52 

.61 

.59 

.45 

Quality  control 

4 

-- 

-- 

-- 

-- 

Total  Program 

100 

.31' 

.25 

.30 

.29 

.25 

(6)  Based  on  a  comparison  of  relative  deviations  (Table  21), 
little  difference  exists  between  the  sum  of  elements  approach  and  the 
total  program  CER  approach. 

Since  there  is  little,  if  any,  advantage  to  mixing  the  set 
size/performance  variables,  the  recommended  equation  set  will  be  chosen 
from  among  the  four  sets  that  maintain  the  integrity  of  the 
size/performance  variable  combination  plus  the  post*1960  set,  Of  the 
four  sets  derived  by  regression  analysis,  the  one  utilizing  airframe 
unit  weight  and  specific  power  probably  has  the  best  statistical 
properties  while  the  set  utilizing  airframe  unit  weight  and  speed  does 
the  best  job  with  respect  to  the  four  most  recent  fighters.  Thus,  of 
the  statistically  derived  sets,  airframe  unit  welght/speed  and  airframe 
unit  weight/specific  power  are  preferred.  However,  on  balance,  we 
recommend  the  post-1960  set  for  the  following  reasons: 

1.  The  set  is  based  on  aircraft  that  are  still  in  operation 
and,  in  some  cases,  still  Jn  production.  Thus,  the  set  is 
based  on  aircraft  that  are  fairly  familiar,  which  should  in 
turn  make  any  necessary  equation  adjustments  easier. 
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XIII.  INCORPORATION  OF  F-16  AND  F-18 


Subsequent  to  the  complrttion  of  the  present  detailed  analysis,  but 
prior  to  the  formal  publication  of  this  Note,  cost  data  on  the  F“16  and 
F-18  airframes  became  available.  Consequently,  a  brief  examination  was 
undertaken  to  determine  whether  inclusion  of  the  F-16  and  F-18  in  the 
database  would  dictate  modification  of  the  recommended  set  of  CERs 
(Table  20).  This  examination  consisted  of  the  following  two  steps: 

(1)  assessing  how  well  the  existing  equation  set  estimates  F-16 
and  F-18  coats;  and, 

(2)  examining  cost  scattergrams  that  include  the  F-16  and  F-18 
to  see  whether  any  changes  in  the  visually  fit  equations 
are  suggested. 

ADJUSTMENT  OF  F-16  PRODUCTION  DATA 

Normally,  in  order  to  arrive  at  the  cumulative  total  production 
cost  for  the  first  100  F-16  airframes,  we  would  take  recorded  data  for 
the  two  prototypes,  eight  FSD  aircraft,  and  the  first  90  aircraft  in  the 
USAF  FY77/78  buy  of  105  aircraft.  However,  because  of  the  concurrent 
multinational  coproduction  effort  (General  Dynamics  produces  all  of  the 
forward  fuselages  and  approximately  half  of  the  quantity  of  all  other 
components),  the  recurring  factory  labor  and  materials  cost  obtained  in 
that  way  would  be  understated  because  of  the  additional  learning  benefit 
associated  with  the  higher  overall  production.  Therefore,  the 
production  labor  and  material  costs  for  the  F-16  are  based  on  90 
"equivalent"  aircraft.  The  estimate  for  the  90  equivalent  aircraft  was 
obtained  by  taking  the  costs  for  the  first  90  production  units  of  each 
component  plus  the  integration  and  assembly  effort  for  the  first  90 
aircraft  and  then  taking  their  sum. 


USING  THE  EXISTING  EQUATION  SET  TO  ESTIMATE  F-16  AND  F-18  COSTS 

A  comparison  of  F-16  and  F-18  actual  costs  to  estimated  costs  using 
the  CERs  provided  in  Table  20  is  presented  in  Table  23.'  ’'ased  on  this 
table,  the  following  observations  are  made: 

•  In  total,  the  fighter  subsample  equation  set  overstates 
F-16  costs  by  about  25  percent  and  understates  F-18  costs 
by  about  20  percent. 

•  The  relative  .deviations  across  cost  elements  for  the  F-18 
show  a  degree  of  uniformity  while  those  for  the  F-16  show 
considerable  divergence- -from  roughly  +10  to  less  than  -60 
percent . 

•  Of  moat  importance  is  the  fact  that,  for  the  F-16,  the 
single  most  important*  cost  oategory--manufacturing  labor-- 
is  overestimated  by  about  50  percent. 

The  fact  that  the  F-16  is  overestimated  and  the  F-18  underestimated 
is  not  all  that  surprising:  The  F-16  program  placed  a  great  deal  of 
emphasis  on  maintaining  cost  goals  while  the  F-18  program  faced  a 
particularly  involved  two-contractor  development.  Specific  reasons 
cited  for  the  F-16's  relatively  low  cost  and  the  F-18's  relatively  high 
cost  are  listed  below. 

F-16 

(1)  Emphasis  on  Simplicity* 

a.  Structural  materials  are  high  percentage  aluminum  (79%) 
and  very  low  percentage  steel,  titanium,  and  composites 
(11%). 

'More  precise  values  could  not  be  provided  because  of  proprietary 
restrictions . 

*In  terms  of  proportion  of  total  cost. 

'List  of  examples  provided  by  Gordon  Fuqua  of  General  Dynamics  Fort 
Worth  Division. 


ESTIMATED  COSTS  WITH  ACTUALS;  RELATIVE  DEVIATIONS 


■ate) /Actual 
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b.  Extensive  use  of  standard  manufacturing  methods- -60 
percent  of  parts  are  sheet  aluminum. 

c.  Used  a  fully  developed  engine  common  to  the  F-15. 

d.  Relatively  few  fastener  types  employed  (50  for  F-16 
versus  250  for  F-111). 

e.  Extensive  use  of  off-the-shelf  equipment  items  (257  out 
373  F-16  items  were  off-the-shelf;  almost  all  of  items 
on  B-58  and  F-111  were  new). 

(2)  Adherence  to  "Design-to-Cost”  Philosophy:  No  major  design 
changes  were  Introduced  by  the  Air  Force  or  General  Dynamics 
during  FSD  and  early  production;  in  fact,  the  first  group  of 
major  changes  to  the  F-16  did  not  occur  until  the  612th 
aircraft.  ** 

(3)  Relatively  high  production  rate  achieved  early  in  program 
(within  2  years  of  the  first  delivery,  General  Dynamics  had 
delivered  roughly  another  175  aircraft  and  the  Europeans 
another  SO).* 


F-18 

(1)  Extensive  use  of  composites:  Roughly  11  percent  of  the  F-18 
structure  weight  la  composites,  far  higher  than  any  prior 
aircraft, * 

(2)  Carrier-based  F-18  is  actually  an  adaptation  of  land-based 
YF-17,  an  adaptation  that  was  complicated  by  the  fact  that  the 
original  design  was  done  by  Northrop  while  the  redesign  was 
primarily  the  responsibility  of  McDonnell. ’ 

“This  initial  sot  of  modifications  is  known  as  Phase  1  of  the 
Multinational  Staged  Improvement  Program  or  Engineering  Change  Proposal 
350  (Gordon  Fuqua,  GD  Fort  Worth). 

*See  Ref.  6,  p.  100. 

*Note,  however,  that  the  AV-8B,  which  was  also  developed  by 
McDonnell  Douglas  and  in  roughly  the  same  timeframe  as  the  F-18,  has 
approximately  25  percent  of  its  structure  weight  in  composites. 

’"On  January  22,  1976,  the  U.S.  Navy  gave  McDonnell  Douglas  the 
go-ahead  to  develop  the  carrier-based  F-18.  Northrop,  the  company  that 
conceived  the  basic  design  of  the  F-18  as  the  F-17,  became  an  associate 
contractor,  assigned  40  percent  of  airframe  development  and  airframe 
production"  (see  Ref.  7,  p.  164). 

*It  has  also  been  suggested  that  F-18  costs  could  be  expected  to  be 
higher  than  the  norm  because  the  aircraft  was  designed  to  satisfy  both 
fighter  and  attack  missions.  However,  in  retrospect  we  do  not  feel  that 
this  was  a  major  contributor  to  the  F-18's  relatively  high  cost  because 
the  fighter  and  attack  configurations  turned  out  to  be  so  similar  (in 
the  attack  version,  a  FLIR  and  laser  tracker  replace  fuselage-mounted 
Sparrow  missiles) . 
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(3)  Difficulty  in  Northrop/McDonnell  relationship  (at  one  point, 
the  two  firms  were  engaged  in  a  court  battle). 

(4)  Relatively  slow  production  rate  buildup;  FSD  (11  aircraft)  was 
followed  by  pilot  production  (9  aircraft)  and  limited 
production  (25  aircraft)  prior  to  initial  full-scale  production 
(60  aircraft) , 

EXAMINING  UPDATED  SCATTERGRAMS 

As  indicated  previously,  six  of  the  eight  CERs  in  the  recommended 
fighter  equation  set  were  determined  by  visually  fitting  a  line  to  4 
observations  (F-4,  F-111,  F-14,  and  F-15).  The  results  of  a  ' 

reexamination  of  the  cost-weight  plots,  updated  to  Include  the  F-16  and 
F-18,  are  presented  in  Table  24.  In  the  course  of  this  reexamination, 
which  was  an  admittedly  subjective  process,  less  emphasis  was  given  to 
the  F-16  than  to  the  other  five  aircraft  In  the  sample.  It  was  given 
less  emphasis  because  wo  did  not  feel  that  it  was  likely  to  be 
representative  of  future  military  aircraft  development  and  production, 

Overall,  the  changes  made  as  a  result  of  updating  the  database  are 
relatively  minor- -labor  hours  increase  by  about  10  percent  while 
material  costs  are  now  subject  to  a  92  percent  weight-scaling  factor 
rather  than  an  85  percent  factor. 


RESULTS  OF  UPDATING  THE  COST-WEIGHT  PLOTS 
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XIV.  CONCLUDING  REMARKS 


RECOMMENDED  EQUATION  SET 

The  equation  set  that  we  believe  Is  the  most  representative  and 
applicable  to  the  widest  range  of  estimating  situations  Is  displayed  In 
Table  25.  With  the  exception  of  development  support  and  quality 
control,  each  of  the  estimating  relationships  shown  in  Table  25  has  bean 
visually  fitted  to  the  data  and  is  based  on  a  sample  consisting  of  only 
the  six  most  recent  f ighters--those  with  first  flight  dates  subsequent 
to  1960.  This  is  a  result  of  observations  made  during  the  course  of  the 
study  that  raised  questions  concerning  the  applicability  of  some  of  the 
older  fighters  in  the  sample  to  fighters  of  the  future.  Consequently, 
additional  analysis  limited  to  post-1960  fighters  was  undertaken.  As  a 
result  of  this  additional  analysis,  we  concluded  that  the  more  limited 
post'1960  experience  would  be  a  better  guide  to  the  future.  The  post- 
1960  fighters  that  served  as  the  basis  for  the  equations  in  Table  25 
have  characteristic  values  that  span  the  ranges  shown  below. 


Characteristic 


Post- 1960 
Database  Range 


Airframe  unit  weight  (lb) 

Empty  weight  (lb) 

Speed  (knots) 

Specific  power  (hp/lb) 

Climb  rate  (ft/min) 

Number  of  flight  test  aircraft 


9,565  -  33,150 

14,062  -  46,170 

1,000+  -  1,250+ 

1.94  -  4+ 

11,600  -  50,000+ 

7  -  20 


CONSTRUCTION/PROGRAM  VARIABLES 

With  the  exception  of  a  variable  that  distinguishes  the  older 
fighters  (which  were  essentially  gun  platforms)  from  the  more  modern 
fighters  with  sophisticated  fire  control  and  missile  armament,  our 
attempts  to  Incorporate  construction  and  program  characteristics  were 
not  successful.  Although  variables  characterizing  the  equipment  placed 
within  the  airframe  structure  were  frequently  found  to  be  statistically 
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Table  25 

RECOMMENDED  SET  OF  FIGHTER  AIRFRAME  CERS  (a) 
(Based  on  post-1960  fighters) 


.887 

ENGR  =2.31  AUW 

100 

.883 

TOOL  =  1.38  AUW 

100 

.678 

LABR  =  25. A  AUW 

100 

.878 

MATL  =43.3  AUW 

100 

DS  =  .75  *  ENGRC  (b) 

1 

.687 

FT  =  27100  TESTAC 


QC  =  .142  *  LABR 

100 

.812 

PROG  =  550  AUW 

100 

(a) RepGaued  from  Parr  B  of  Table  24. 

-  164 

(b) ENGRC^  =  $27.50  *  ENGR^^^q  *  100  * 

significant,  they  did  not,  as  a  rule,  result  in  any  substantial 
improvement  Jn  the  quality  of  the  equations.  In  most  cases,  the 
equations  Incorporating  such  variables  did  not  produce  results  that  we 
viewed  as  credible.  Moreover,  oven  in  those  few  instances  where  the 
equations  did  produce  credible  results,  the  reduction  in  the  standard 
error  of  estimate  was  never  more  than  two  or  three  percentage  points. 


i 


I 


« 


I 


TECHNOLOGY  INDEX 


We  were  able  to  identify  only  one  instance  (for  the  engineering 
cost  element)  in  which  the  objective  technology  index  (PFFD)  was 
significant  at  the  S  percent  level  in  the  context  of  the  tested  variable 
combination  (size/performance/technology  index): 


ENGR 

100 


1.13  .367  .697 

.00242  AUW  SPPWR  PFFD 

(.000)  (.021)  (.016) 


2 

R  SEE  F  N 


.97  .16  134  IS 


where 


AUW  =  airframe  unit  weight  (lb) 

PFFD  =  predicted  first  flight  date 

(monthiS  since  January  1,  1940) 

SPPWR  =  specific  power  (hp/lb) 

However,  the  correlation  of  AUW  end  SPPWR  with  the  technology  index  is 
greater  than  0.9.  Furthermore,  the  equation  offers  little  advantage  (in 
terms  of  the  standard  error  of  estimate)  over  alternative  forms  without 
the  technology  index.  We  conclude  that  the  objective  technology  index, 
as  now  defined,  is  of  little  benefit  to  fighter  airframe  CERs .  The 
reason  it  did  so  poorly  in  our  analysis  is  that  it  is  really  a  composite 
performance  variable  and  consequently  very  highly  correlated  with  most 
of  the  performance  variables  we.  tested  here.  It  should  be  noted  that 
when  the  measure  is  treated  as  a  performance  variable  rather  than  as  a 
technology  index,  it  does  about  as  well  as  speed  and  specific  power  as 
an  explanatory  variable. 
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COMPARISON  TO  FULL  ESTIMATING  SAMPLE  EQUATION  SET 

A  comparison  of  how  accurately  the  full  estimeting  equ»ition  set 
(Table  26)  and  the  fighter  subsample  equation  set  (Table  25)  estimate 
the  costs  of  the  six  post- 1960  fighters  is  provided  in  Table  27.  On  an 
overall  average  basis,  the  fighter  equation  set  does  slightly  better. 
However,  there  is  a  considerable  difference  between  the  two  sets  with 
respect  to  which  will  produce  the  higher  estimate.  As  shown  below,  the 
fighter  equation  set  produces  considerably  higher  estimates  for  the  F-16 
and  F-lfi  than  does  the  full  estimating  sample  equation  set: 


Percentage  by  Which  Fighter  Set  Estimate 
Exceeds  All-Mission  Set  Estimate 


Aircraft  Sum  of  Elements  Total  Program  CER 


F-16  8  3 

F-18  22  22 


However,  for  the  remaining  fighters,  all  of  which  are  heavier  and  faster 
than  the  F-16  and  F-i8,  the  all-mission  typo  equation  set  tends  to 
produce  estimates  that  arc  greater  than  those  produced  by  the  fighter 
sample  equation  set: 


Percentage  by  Which  All-Mission  Set 
Estimate  Exceeds  Fighter  Set  Estimate 


Aircraft  Sum  of  Elements  Total  Program  CER 


F-4  8 

F-111  4 

F-14  4 

F-15  15 


11 

1 

4 

13 


Table  26 


RECOMMENDED  SET  OF  AIRFRAME  CERs  BASED  ON  FULL  ESTIMATING  SAMPLE 


2 

Equation  R  SEE  F  N 


.777  .894 

ENGR  ■  .0103  EW  SP  .72  .55  13  13 

100  (.000)  (.000)(a) 

.777  .696 

TOOL  ■  .0201  EW  SP  .92  .25  56  13 

100  (.000)  (.000) 

.820  .484 

LABR  «  .141  EW  SP  .88  .31  38  13 

100  (.000)  (.013) 

.921  .621 

MATL  »  .241  EW  SP  .91  .30  51  13 

100  (.000)  (.003) 

.630  1.30 

DS  •  .0251  EW  SP  .54  .82  6  13 

(.016)  (.012) 

,325  .822  1.21 

FT  «  .687  EW  SP  TESTAC  .83  ,48  15  13 

(.032)  (.037)  (.010) 

QC  »  ,076  X  LABR  if  cargo  aircraft  . -  2 

100  100 

»  .133  X  LABR  if  non-cargo  aircraft  --  --  --  11 

100 

.798  .736 

PROG  B  2,57  EW  SP  .85  .36  29  13 

100  (.000)  (.003) 


SOURCE:  N-2283/1-AF,  Table  1. 

NOTES:  Statistics  in  right-hand  columns  are  coefficient  of 
determination,  standard  error  of  estimate  (logarithm),  F-statlstic, 
and  sample  size.  Numbers  in  parentheses  are  significance  levels 
of  individual  variables. 

DS  »  development  support  cost  (thousands  of  1977  dollars). 

ENGR  *»  cumulative  engineering  hours  for  100  aircraft 
100  (thousands). 

EW  =  empty  weight  (lb). 

FT  =  flight  test  cost  (thousands  of  1977  dollars), 

LABR  ®  cumulative  manufacturing  labor  hours  for  100  aircraft 

100  (thousands). 

MATL  *  cumulative  manufacturing  material  dollars  for  100  aircraft 
100  (thousands  of  1977  dollars). 

QC  «  cumulative  quality  control  hours  for  100  aircraft 

100  (thousands). 

PROG  =  cumulative  total  program  cost  for  JOO  aircraft  (thousands 
100  of  1977  dollars). 

SP  =  maximum  speed  (kn) . 

TESTAC  =  number  of  flight  test  aircraft. 

TOOL  »  cumulative  tooling  hours  for  100  aircraft  (thousands). 


100 
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Table  27 

RELATIVE  ACCURACY  OF  ESTIMATES  OBTAINED  USING 
FULL  ESTIMATING  SAMPLE  AND  FIGHTER  SUBSAMPLE  EQUATION  SETS 


Percentage  by  Which  Actual  Cost  Exceeds  (+) 
or  Falls  Short  (-)  of  Estimated  Cost 


Sum  of  Elements  Total  Program  CER 


Aircraft 

All  Mission 
Sample 

Fighter 

Sample 

All  Mission 
Sample 

Fighter 

Sample 

F-4 

-14 

-  5 

-16 

-  4 

F-lll 

+  3 

+  6 

+  7 

+  7 

F-14 

-22 

-17 

-20 

-16 

F-15 

-IS 

-  1 

-  5 

+  7 

F-16 

-23 

-33 

-20 

-23 

F-18 

+33 

+18 

+36 

+22 

Average  of  Absolute  Values 

18 

13 

17 

13 

Number  Underestimated  (+) 

2 

2 

2 

3 

Number  Overestimated  (-) 

4 

4 

4 

3 

Exactly  which  equation  set 

will  provide  the  higher  estimate  in 

any  given 

situation  depends  on  a  number  of  factors  including  not  only  the 
aircraft's  airframe  unit  weight  and  speed,  but  also  the  relative 


I  difference  in  its  empty  weight  and  airframe  unit  weight.  In  general, 

however,  it  would  appear  that  the  all-mission  type  equation  sot  will 
produce  higher  estimates  for  heavier,  faster  fighters  while  the  fighter 
equation  set  will  produce  higher  estimates  for  smaller,  "slower" 

I  fighters. 


COST-QUANTITY  SLOPES 

Minimum,  maximum,  and  average  cost-quantity  slopes  for  the  fighter 
aircraft  subsample  are  provided  in  Table  28.  However,  the  recommended 
equation  set  (Table  25)  is  based  on  a  sample  limited  to  post-1960 
aircraft.  Consequently,  average  cumulative  total  slopes  of  the  post- 
1960  sample  are  determined  and  compared  to  the  full  fighter  sample 
(equivalent  exponents  in  parentheses): 
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Table  28 

CUMULATIVE  TOTAL  COST-QUANTITY  SLOPES 


Engineering 

Tooling 

Mfg. 

Labor 

Mfg 

Material 

Quality 

Control 

Total 

Program 

Number  of 

observations 

17 

17 

17 

17 

10 

17 

Range  (%) 

110-124 

110-158 

142-182 

140-200 

146-234 

124-144 

Average  (%) 

116 

124 

156 

172 

170 

132 

Exponent 

.214 

.310 

.642 

.782 

.760 

.400 

NOTES:  Based 

on  first  200 

units ;  ( 

cumulative 

1  average 

slope  = 

cumulative  total  slope  divided  by  two. 


Full  Post- 1960 

Cost  Elemont  Fighter  Sample  Fighter  Sample 

%  % 


Engineering 

116 

112  (.163) 

Tooling 

124 

120  (.263) 

Manufacturing  labor 

156 

158  (.660) 

Manufacturing  material 

172 

166  (.731) 

Quality  control 

170 

164  (.714) 

Total  program  cost 

132 

128  (.356) 

As  Indicated,  the  differences  are  slight  and  hardly  a  basis  for  drawing 
any  conclusions.  Nevertheless,  the  slopes  based  on  the  post-1960  sample 
ere  recommended  for  consistency  with  the  recommended  equation  set. 


FULLY  BURDENED  LABOR  RATES 

All  cost  elements  estimated  directly  in  dollars  are  in  1977 
dollars.  Suggested  1977  fully  burdened  hourly  labor  rates  (and  those 
used  to  estimate  total  program  cost)  are: 


Engineering 

27.50 

Tooling 

25.50 

Manufacturing  labor 

23.50 

Quality  control 

24.00 
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For  estimates  in  1966  dollars,  the  following  hourly  labor  rates  and 
adjustment  factors  are  suggested: 


Engineering  59.10 
Tooling  60.70 
Manufacturing  labor  50.10 
Quality  control  55.40 
Manufacturing  material  (index)  1.94 
Development  support  (index)  1.94 
Flight  test  (index)  1.94 
Total  program  (index)  2.13 


The  1986  labor  rates  are  based  on  data  provided  by  seven  contractors: 


Hourly  Rates 

($) 

Labor  Category 

Average 

Range 

Range  about 
Average  (%) 

Engineering 

59.10 

47.70  - 

70.00 

-19,  +18 

Tooling 

60.70 

56.50  - 

65.00 

-  7,  +  7 

Manufacturing  labor 

50.10 

41.70  - 

58.00 

-17,  +16 

Quality  Control 

55.40 

49.10  - 

62.60 

-11,  +13 

Note  that  with  the  exception  of  tooling,  the  range  about  the  average 
rate  is  at  least  +  or  -10%.  Such  differences  could  arise  from 
differences  in  accounting  practices,  business  bases,  and  capital 
investment,  Irrespective  of  cause,  however,  labor  rate  variation  is  one 
more  component  of  a  larger  uncertainty  which  already  includes  the  error 
associated  with  statistically  derived  estimating  relationships  and 
questions  about  the  proper  cost-quantity  slope.  Furthermore,  in 
addition  to  the  intercontractor  differences,  these  rates  are  also 
subject  to  temporal  change- -accounting  procedures,  relative 
capital/labor  ratio,  etc.  Thus,  the  1986  fully  burdened  rate  is 
qualitatively  different  than  the  1977  rate.  Unfortunately,  trying  to 
estimate  the  magnitude  of  such  quality  changes,  even  very  crudely,  is 
beyond  the  scope  of  this  analysis. 
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The  material,  development  support,  and  flight  test  escalation 
indexes  are  based  on  data  provided  in  AFR  173-13.'  For  the  years 
1977-1984,  the  airframe  index  presented  in  Table  .'5-3  ("Historical 
Aircraft  Component  Inflation  Indices")  was  used.  For  the  years  1985  and 
1986,  the  aircraft  and  missile  procurement  index  presented  in  Table  5-2 
("USAF  Weighted  Inflation  Indices  Based  on  OSD  Raw  Inflation  and  Outlay 
Rates")  was  used.  The  total  program  cost  adjustment  factor  was  then 
determined  on  the  basis  of  a  weighted  average  (at  q  =  100)  of  the 
individual  cost  elements. 

FINAL  COMMENTS 

The  recommended  equation  set  uses  only  one  variable--air£rame  unit 
weight“-and  is  based  on  a  subsample  consisting  of  six  post-1960 
fighters.  This  equation  set,  which  was  visually  fit  to  the  data, 
provides  results  that  we  believe  to  be  more  credible  than  those  produced 
by  multiple  least-squares  regression  analysis  of  the  full  fighter 
aircraft  sample. 

The  ultimate  tost  of  the  set's  usefulness  will  be  its  ability  to 
estimate  the  cost  of  future  fighters.  Unfortunately  (from  an  estimating 
point  of  view),  airframes  are  changing  dramatically  with  respect  to 
materials  (e.g. ,  more  extensive  use  of  composites),  design  concepts 
(e.g.,  concepts  to  increase  fuel  efficiency  and  to  reduce  radar  cross- 
section),  and  manufacturing  techniques  (e,g.,  utilization  of  computers 
and  robots).  We  believe  the  material  and  design  changes  will  act  to 
increase  unit  costs  but  are  uncertain  of  the  net  impact  of  capita] 
equipment  changes.  In  any  case,  it  is  unlikely  that  any  of  the  equation 
sets  presented  in  this  document  will  overestimate  the  costs  of  future 
fighters . 


'See  Ref.  8. 
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Appendix  A 

CORRELATION  MATRIXES 

This  appendix  contains  correlation  matrixes  for  the  "basic"  fighter 
estimating  sample  (15  aircraft).^  Table  A.l  provides  Pearson  correlation 
coefficients  for  all  possible  pairwise  combinations  of  dependent  and 
independent  variables.  Table  A. 2  provides  coefficients  for  all  possible 
pairwise  combinations  of  independent  variables. 

^These  correlation  coefficients  were  usi’id  in  conjunction  with  the 
work  completed  prior  to  the  incorporation  of  the  F-16  and  F-18. 


Table  A.l 


CORRELATION  MATRIX:  COST  VARIABLES  WITH 
POTENTIAL  EXPLANATORY  VARIABLES 


COST 


SKPLANArOPy 

VAP/ABies 

A 

£R6R 

jisA 

root 

A 

lABP 

At 

/yarc 

A 

BGysPT 

Fl^ST 

A 

PROG 

s/ze 

Ai/tv 

o.as 

0.7/ 

0.62 

0.66 

0.76 

0.63 

0.B4 

£IV 

o.ae 

0.76 

0.67 

0.69 

0.63 

0.63 

0. 39 

hrrAf?£A 

0.70 

0.7A 

o.ae 

0.62 

0.67 

0.66 

0.64 

jUt  sPsejD 

0.66 

0.7/ 

0.69 

0.62 

0,66 

0.77 

0.76 

Jh  specs 

0.76 

0.68 

0.6/ 

0,74 

0.66 

0,73 

0,70 

Jrt  SPPy/R 

0.60 

0.69 

o.se 

0.73 

o.ss 

0.76 

0.72 

/n  £/^£PQy 

0.67 

O.sa 

0.67 

0.30 

0.S3 

0,72 

0,  76 

CC/MS 

0.63 

O.S2 

0.43 

0.62 

0.36 

0.62 

0.  64 

st/scz> 

0.36 

0.33 

0.26 

0.23 

0.96 

0,47 

0.34 

Jtn  TA/tVr 

0.6/ 

0.67 

0.46 

0.6/ 

0.43 

0.66 

0.67 

/»  apGG 

0.70 

0.60 

0.43 

0.66 

0.7/ 

0.67 

0.64 

At  c/sscp 

0.66 

0.36 

0.4/ 

0.37 

0.93 

0.3/ 

0.38 

At  pppi> 

0.66 

0.69 

0.6/ 

0.78 

0.64 

0.79 

0.77 

CONSTRUCr/ON 

At  t/criD 

0.36 

0.37 

0.32 

0.30 

0.24 

0.44 

0.39 

A  STR£FF 

-0.30 

-o.es 

-0./3 

-0.26 

-0.33 

-  0‘  63 

-  0.96 

A  CARRI>V 

-  0.06 

0.00 

0./6 

0.03 

-0./4 

-0.07 

0.00 

A  y/oryPG 

o.sa 

0.72 

0.46 

0.62 

0.64 

0.6/ 

0.64 

A  lyci^sT 

0. 37 

-o.os 

-0./7 

-0.94 

-O,  // 

-O.OS 

-0.9/ 

A 

'■O.A 

-O.OS 

-0./2 

-0.07 

0.04 

0.26 

-0.06 

A  AyAUiR 

-0.0/ 

0.24 

0./9 

0./2 

0.20 

0./6 

0./6 

A  BCBOZ 

0.6S 

0.74 

0.6/ 

o.as 

0.76 

0,60 

O.as 

PROGRAM 

A  resrAc 

o.  /s 

0.37 

0.0/ 

0./6 

0.43 

0.66 

0.93 

A  rooLCP 

-O.SA 

-0.34 

-  0,63 

-0.63 

-0.30 

-0.33 

-0. 49 

A  £RCX)\/ 

0.// 

0.0/ 

0.02 

-  0.03 

-0.03 

0.09 

0.03 

A  exPDy 

-0. 03 

0.07 

0.02 

-0.04 

0.// 

-0.20 

0.0/ 

A  iRSOV 

0.6/ 

0.79 

0.76 

0.6/ 

0,76 

0.7/ 

0.83 

A  PPOCDV 

-0.77 

-0.77 

-0.76 

-0.6/ 

-0.36 

-0,73 

-0,66 

CORRELATION  MATRIX  FOR  IDENTIFICATION  OF  PAIRWISE  COLLINEARITY 
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NOTE:  Combinations  above  and  to  the  right  of  heavy  line  were  not  considered  because  of  the  study  assumption  that 

an  estimating  relationship  would  not  contain  more  than  one  variable  from  each  class. 
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Appendix  B 

CALCULATED  COSTS  FOR  ALTERNATIVE  EQUATION  SETS 


Section  XII  of  this  draft  summarized  several  alternative  equation 
sets  with  respect  to  how  closely,  in  percentage  terms,  they  estimated 
the  actual  costs  of  the  F-4,  F-111,  F-14,  and  F-15.  This  appendix 
contains  a  breakdown,  by  cost  element,  of  these  equation  set  estimates. 


Table  B.4 
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